Sep 03 10:48:40 devstack cinder-volume[75635]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 10:48:40 devstack cinder-volume[75635]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 10:48:40 devstack cinder-volume[75635]: we strongly recommend against using it for new projects. Sep 03 10:48:40 devstack cinder-volume[75635]: If you are already using Eventlet, we recommend migrating to a different Sep 03 10:48:40 devstack cinder-volume[75635]: framework. For more detail see Sep 03 10:48:40 devstack cinder-volume[75635]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 10:48:40 devstack cinder-volume[75635]: import eventlet # noqa Sep 03 10:48:43 devstack cinder-volume[75635]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 10:48:43 devstack cinder-volume[75635]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 10:48:43 devstack cinder-volume[75635]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 10:48:44 devstack cinder-volume[75635]: INFO dbcounter [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Registered counter for database cinder Sep 03 10:48:44 devstack cinder-volume[75635]: DEBUG oslo_db.sqlalchemy.engines [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75635) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:48:44 devstack cinder-volume[75635]: DEBUG dbcounter [-] [75635] Writer thread running {{(pid=75635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 10:48:44 devstack cinder-volume[75635]: INFO cinder.rpc [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 10:48:44 devstack cinder-volume[75635]: INFO cinder.rpc [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 10:48:44 devstack cinder-volume[75635]: DEBUG oslo_db.sqlalchemy.engines [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75635) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:48:44 devstack cinder-volume[75635]: INFO cinder.volume.manager [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Determined volume DB was empty at startup. Sep 03 10:48:44 devstack cinder-volume[75635]: DEBUG cinder.volume.manager [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75635) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 10:48:44 devstack cinder-volume[75635]: INFO cinder.volume.manager [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 10:48:44 devstack cinder-volume[75635]: WARNING stevedore.named [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 10:48:44 devstack cinder-volume[75635]: WARNING castellan.key_manager [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 10:48:44 devstack cinder-volume[75635]: WARNING cinder.keymgr.conf_key_mgr [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 10:48:44 devstack cinder-volume[75635]: DEBUG cinder.volume.drivers.lvm [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75635) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 03 10:48:44 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_concurrency.processutils [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] CMD "cinder-rtstool verify" returned: 0 in 0.431s {{(pid=75635) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_db.sqlalchemy.engines [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75635) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:48:45 devstack cinder-volume[75635]: INFO cinder.rpc [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 03 10:48:45 devstack cinder-volume[75635]: INFO cinder.rpc [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 03 10:48:45 devstack cinder-volume[75635]: WARNING stevedore.named [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 10:48:45 devstack cinder-volume[75635]: WARNING castellan.key_manager [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 10:48:45 devstack cinder-volume[75635]: INFO cinder.volume.manager [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_db.sqlalchemy.engines [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75635) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:48:45 devstack cinder-volume[75635]: INFO oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Starting 1 workers Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Started child 75826 {{(pid=75635) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Full set of CONF: {{(pid=75635) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] ******************************************************************************** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Configuration options gathered from: {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] ================================================================================ {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] allow_availability_zone_fallback = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] allow_compression_on_image_upload = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] allowed_direct_url_schemes = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] api_rate_limit = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] auth_strategy = keystone {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] az_cache_duration = 3600 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_availability_zone = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_host = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75826]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_stats_polling_interval = 60 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backup_api_class = cinder.backup.api.API {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backup_name_template = backup-%s {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backup_use_same_host = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backup_use_temp_snapshot = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] chap_password = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] chap_username = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cinder_internal_tenant_project_id = 7bb7b05108564871a90ff2badb223b4d {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cinder_internal_tenant_user_id = 88432713eb1d49ce8adcad707a34cd3d {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cloned_volume_same_az = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cluster = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] compression_format = gzip {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] compute_api_class = cinder.compute.nova.API {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] config_dir = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] config_source = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] control_exchange = openstack {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] debug = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] default_availability_zone = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] default_group_type = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] default_volume_type = lvmdriver-1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] disk_geometry = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] driver_client_cert = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] driver_client_cert_key = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] driver_data_namespace = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] driver_ssl_cert_path = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] driver_ssl_cert_verify = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] driver_use_ssl = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] enable_force_upload = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] enable_new_services = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] enable_unsupported_driver = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] enforce_multipath_for_image_xfer = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] filter_function = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_api_insecure = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_api_servers = ['http://192.168.122.139/image'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_api_ssl_compression = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_ca_certificates_file = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_catalog_info = image:glance:publicURL {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_certfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_keyfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_num_retries = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance_request_timeout = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] goodness_function = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] graceful_shutdown_timeout = 5 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] group_api_class = cinder.group.api.API {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] host = devstack {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_compress_on_upload = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_conversion_address_space_limit = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_conversion_cpu_limit = 60 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_conversion_disable = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_upload_use_cinder_backend = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_upload_use_internal_tenant = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_volume_cache_enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_volume_cache_max_count = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] image_volume_cache_max_size_gb = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] init_host_max_objects_retrieval = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] instance_format = [instance: %(uuid)s] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] iscsi_target_flags = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] iscsi_write_cache = on {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] iser_helper = tgtadm {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] iser_ip_address = 192.168.122.139 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] iser_port = 3260 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] log_color = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] log_config_append = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] log_dir = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] log_file = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] log_options = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] log_rotate_interval = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] log_rotate_interval_type = days {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] log_rotation_type = none {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] max_age = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] max_logfile_count = 30 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] max_logfile_size_mb = 200 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] max_over_subscription_ratio = 20.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] message_reap_interval = 86400 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] message_ttl = 2592000 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] migration_create_volume_timeout_secs = 300 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] monkey_patch = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] monkey_patch_modules = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] my_ip = 192.168.122.139 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] no_snapshot_gb_quota = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] num_iser_scan_tries = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] num_shell_tries = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] num_volume_device_scan_tries = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] nvmeof_conn_info_version = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] nvmet_ns_id = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] nvmet_port_id = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] osapi_max_limit = 1000 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] osapi_volume_ext_list = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] osapi_volume_listen_port = 8776 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] osapi_volume_use_ssl = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] osapi_volume_workers = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] per_volume_size_limit = -1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] periodic_fuzzy_delay = 60 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] periodic_interval = 60 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] public_endpoint = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] publish_errors = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] quota_backup_gigabytes = 1000 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] quota_backups = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] quota_gigabytes = 1000 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] quota_groups = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] quota_snapshots = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] quota_volumes = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] rate_limit_burst = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] rate_limit_except_level = CRITICAL {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] rate_limit_interval = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] reinit_driver_count = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] replication_device = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] report_discard_supported = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] report_interval = 120 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] reservation_clean_interval = 86400 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] reservation_expire = 86400 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] reserved_image_namespaces = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] reserved_percentage = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] rpc_response_timeout = 120 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] run_external_periodic_tasks = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] scst_target_driver = iscsi {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] scst_target_iqn_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_down_time = 720 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] shell_completion = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] snapshot_name_template = snapshot-%s {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] snapshot_same_host = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] split_loggers = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] state_path = /opt/stack/data/cinder {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] storage_availability_zone = nova {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] storage_protocol = iSCSI {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] syslog_log_facility = LOG_USER {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] target_helper = lioadm {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] target_ip_address = 192.168.122.139 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] target_port = 3260 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] target_protocol = iscsi {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] target_secondary_ip_addresses = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] trace_flags = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] transport_url = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] until_refresh = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] use_chap_auth = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] use_default_quota_class = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] use_journal = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] use_json = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] use_multipath_for_image_xfer = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] use_stderr = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] use_syslog = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] verify_glance_signatures = enabled {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_api_class = cinder.volume.api.API {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_backend_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_clear = zero {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_clear_ionice = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_clear_size = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_copy_bps_limit = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_dd_blocksize = 1M {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_name_template = volume-%s {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_service_inithost_offload = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volume_usage_audit_period = month {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] zoning_mode = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_concurrency.disable_process_locking = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.auth_section = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.auth_type = password {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.auth_version = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.cache = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.certfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.include_service_catalog = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.insecure = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.interface = public {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.keyfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_password = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcache_username = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.region_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:45 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.service_type = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.139/identity {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.backend = dogpile.cache.null {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.backend_argument = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.backend_expiration_time = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.config_prefix = cache.oslo {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.debug_cache_backend = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.enable_retry_client = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.enable_socket_keepalive = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.expiration_time = 600 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.hashclient_retry_attempts = 2 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.memcache_dead_retry = 300 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.memcache_pool_maxsize = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.memcache_sasl_enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.password = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.proxies = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.redis_db = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.redis_server = localhost:6379 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.retry_attempts = 2 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.retry_delay = 0.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.socket_keepalive_count = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.socket_keepalive_idle = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.socket_keepalive_interval = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.socket_timeout = 1.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.tls_allowed_ciphers = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.tls_cafile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.tls_certfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.tls_enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.tls_keyfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cache.username = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] coordination.backend_url = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.asyncio_connection = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.asyncio_slave_connection = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.backend = sqlalchemy {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.connection = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.connection_debug = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.connection_parameters = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.connection_recycle_time = 3600 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.connection_trace = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.db_inc_retry_interval = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.db_max_retries = 20 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.db_max_retry_interval = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.db_retry_interval = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.max_overflow = 50 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.max_pool_size = 5 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.max_retries = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.mysql_wsrep_sync_wait = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.pool_timeout = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.retry_interval = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.slave_connection = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.sqlite_synchronous = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.synchronous_reader = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] database.use_db_reconnect = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:45 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_tracing.insecure = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.connection_string = messaging:// {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.es_doc_type = notification {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.es_scroll_size = 10000 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.es_scroll_time = 2m {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.filter_error_trace = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.hmac_keys = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.sentinel_service_name = mymaster {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.socket_timeout = 0.1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.trace_requests = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler.trace_sqlalchemy = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler_jaeger.process_tags = {} {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler_jaeger.service_name_prefix = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] profiler_otlp.service_name_prefix = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.enforce_new_defaults = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.policy_default_rule = default {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.policy_file = policy.yaml {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] privsep_osbrick.group = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] privsep_osbrick.helper_command = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] privsep_osbrick.user = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cinder_sys_admin.group = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cinder_sys_admin.helper_command = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] cinder_sys_admin.user = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.auth_section = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.auth_type = password {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.cafile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.certfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.collect_timing = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.insecure = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.keyfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.send_service_user_token = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.split_loggers = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.timeout = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.tls_ciphers = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] service_user.tls_min_version = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.auth_section = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.auth_type = password {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.certfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.collect_timing = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.insecure = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.keyfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.region_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.split_loggers = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.timeout = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.tls_ciphers = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] glance.tls_min_version = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.backend_availability_zone = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.chap_password = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.chap_username = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.disk_geometry = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.driver_client_cert = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.driver_client_cert_key = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.driver_data_namespace = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.driver_use_ssl = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.extra_capabilities = {} {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.filter_function = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.goodness_function = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.iscsi_target_flags = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.iscsi_write_cache = on {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.iser_helper = tgtadm {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.iser_ip_address = 192.168.122.139 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.iser_port = 3260 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.lvm_share_target = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.lvm_type = auto {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.num_shell_tries = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.replication_device = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.report_discard_supported = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.reserved_percentage = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.target_helper = tgtadm {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.target_ip_address = 192.168.122.139 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.target_port = 3260 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.target_protocol = iscsi {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.trace_flags = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.unique_fqdn_network = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.use_chap_auth = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volume_backend_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volume_clear = zero {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volume_clear_ionice = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volume_clear_size = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_reports.file_event_handler = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_reports.log_dir = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.backend_host = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.chap_password = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.chap_username = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.disk_geometry = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.driver_client_cert = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.extra_capabilities = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.filter_function = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.goodness_function = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.iser_helper = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.iser_ip_address = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.iser_port = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.lvm_share_target = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.lvm_type = auto {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.num_shell_tries = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.replication_device = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.report_discard_supported = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.reserved_percentage = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.scst_target_driver = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.storage_protocol = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.target_helper = lioadm {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.target_ip_address = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.target_port = 3260 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.trace_flags = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.use_chap_auth = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volume_clear = zero {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volume_clear_size = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] lvmdriver-1.volumes_dir = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.ssl = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_notifications.driver = [] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_notifications.retry = -1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] key_manager.fixed_key = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.barbican_api_version = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.barbican_endpoint = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.barbican_endpoint_type = public {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.barbican_region_name = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.cafile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.certfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.collect_timing = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.insecure = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.keyfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.number_of_retries = 60 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.retry_delay = 1 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.send_service_user_token = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack sudo[75833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.split_loggers = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.timeout = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.tls_ciphers = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack sudo[75833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.tls_min_version = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.verify_ssl = True {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican.verify_ssl_path = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.auth_section = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.auth_type = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.cafile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.certfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.collect_timing = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.insecure = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.keyfile = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.split_loggers = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.timeout = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.tls_ciphers = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] barbican_service_user.tls_min_version = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.approle_role_id = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.approle_secret_id = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.auth_method = approle {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.auth_path = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.kv_mountpoint = secret {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.kv_path = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.kv_version = 2 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.namespace = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.root_token_id = **** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.ssl_ca_crt_file = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.timeout = 60.0 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.token_file = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.token_role = None {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.use_ssl = False {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:48:45 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] ******************************************************************************** {{(pid=75635) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 10:48:46 devstack sudo[75833]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:46 devstack sudo[75836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:48:46 devstack sudo[75836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:46 devstack sudo[75836]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.303s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 10:48:46 devstack cinder-volume[75826]: INFO cinder.brick.local_dev.lvm [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:46 devstack sudo[75843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 10:48:46 devstack sudo[75843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:46 devstack sudo[75843]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG cinder.brick.local_dev.lvm [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75826) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 03 10:48:46 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:46 devstack sudo[75953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:48:46 devstack sudo[75953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:47 devstack sudo[75953]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.535s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:47 devstack sudo[76160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:48:47 devstack sudo[76160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:47 devstack sudo[76160]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:47 devstack sudo[76274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 03 10:48:47 devstack sudo[76274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:47 devstack sudo[76274]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.252s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:47 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:47 devstack sudo[76369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 10:48:47 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:48 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:48 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:48 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:48 devstack sudo[76449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 10:48:48 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:48 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:48 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:48 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:48 devstack sudo[76457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:48:48 devstack sudo[76457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:48 devstack sudo[76457]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:48 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:48 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:48 devstack sudo[76536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:48:48 devstack sudo[76536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:49 devstack sudo[76536]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:49 devstack sudo[76546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:48:49 devstack sudo[76546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:49 devstack sudo[76546]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:49 devstack cinder-volume[75826]: INFO cinder.volume.drivers.lvm [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:49 devstack sudo[76636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:48:49 devstack sudo[76636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:49 devstack sudo[76636]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG cinder.volume.drivers.lvm [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Updating volume stats {{(pid=75826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:49 devstack sudo[76639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 10:48:49 devstack sudo[76639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:49 devstack sudo[76639]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:49 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:49 devstack sudo[76643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:48:49 devstack sudo[76643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:50 devstack sudo[76643]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:50 devstack sudo[76646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:48:50 devstack sudo[76646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:50 devstack sudo[76646]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:50 devstack sudo[76649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:48:50 devstack sudo[76649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:50 devstack sudo[76649]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:50 devstack cinder-volume[75826]: INFO cinder.volume.driver [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG cinder.volume.driver [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75826) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writer thread running {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG cinder.db.api [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Building query based on filter {{(pid=75826) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG cinder.image.image_utils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75826) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 10:48:50 devstack cinder-volume[75826]: INFO cinder.keymgr.migration [None req-c7e57399-dc66-423f-b72f-0afeb34adfe1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG cinder.volume.drivers.lvm [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Updating volume stats {{(pid=75826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 10:48:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:50 devstack sudo[76653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 10:48:50 devstack sudo[76653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:51 devstack sudo[76653]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:51 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:51 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:51 devstack sudo[76656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:48:51 devstack sudo[76656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:51 devstack sudo[76656]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:51 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:51 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:51 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:48:51 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:51 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:51 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:51 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:51 devstack sudo[76664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:48:51 devstack sudo[76664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:52 devstack sudo[76664]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG cinder.manager [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Notifying Schedulers of capabilities ... {{(pid=75826) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:48:52 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Driver initialization completed successfully. Sep 03 10:48:52 devstack cinder-volume[75826]: INFO cinder.manager [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Initiating service 2 cleanup Sep 03 10:48:52 devstack cinder-volume[75826]: INFO cinder.manager [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Service 2 cleanup completed. Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG cinder.service [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Creating RPC server for service cinder-volume {{(pid=75826) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG cinder.service [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75826) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 10:48:52 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG cinder.volume.drivers.lvm [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Updating volume stats {{(pid=75826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:52 devstack sudo[76668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 10:48:52 devstack sudo[76668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:52 devstack sudo[76668]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:52 devstack sudo[76674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:48:52 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:52 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:52 devstack sudo[76679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:48:52 devstack sudo[76679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:52 devstack sudo[76679]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:48:52 devstack sudo[76682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:48:52 devstack sudo[76682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:48:53 devstack sudo[76682]: pam_unix(sudo:session): session closed for user root Sep 03 10:48:53 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:48:53 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-752a70c2-4897-4ad6-967d-6205ef8557c7 None None] Driver post RPC initialization completed successfully. Sep 03 10:48:55 devstack cinder-volume[75635]: DEBUG dbcounter [-] [75635] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75635) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:49:03 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writing DB stats cinder:SELECT=4 {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:49:03 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:49:12 devstack cinder-volume[75826]: DEBUG oslo_service.periodic_task [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running periodic task VolumeManager._thread_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:49:12 devstack cinder-volume[75826]: DEBUG cinder.volume.manager [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] thread count: 6 {{(pid=75826) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 10:49:12 devstack cinder-volume[75826]: DEBUG cinder.volume.manager [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] thread info: [<_MainThread(MainThread, started 123559376887936)>, , , , , ] {{(pid=75826) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 10:50:12 devstack cinder-volume[75826]: DEBUG oslo_service.periodic_task [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:50:12 devstack cinder-volume[75826]: DEBUG cinder.volume.drivers.lvm [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Updating volume stats {{(pid=75826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 10:50:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:50:12 devstack sudo[79311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 10:50:12 devstack sudo[79311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:50:12 devstack sudo[79311]: pam_unix(sudo:session): session closed for user root Sep 03 10:50:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:50:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:50:12 devstack sudo[79314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:50:12 devstack sudo[79314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:50:12 devstack sudo[79314]: pam_unix(sudo:session): session closed for user root Sep 03 10:50:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:50:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:50:12 devstack sudo[79317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:50:12 devstack sudo[79317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:50:13 devstack sudo[79317]: pam_unix(sudo:session): session closed for user root Sep 03 10:50:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:50:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:50:13 devstack sudo[79320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:50:13 devstack sudo[79320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:50:13 devstack sudo[79320]: pam_unix(sudo:session): session closed for user root Sep 03 10:50:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:50:13 devstack cinder-volume[75826]: DEBUG cinder.manager [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Notifying Schedulers of capabilities ... {{(pid=75826) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:50:13 devstack cinder-volume[75826]: DEBUG oslo_service.periodic_task [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running periodic task VolumeManager._thread_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:50:13 devstack cinder-volume[75826]: DEBUG cinder.volume.manager [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] thread count: 6 {{(pid=75826) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 10:50:13 devstack cinder-volume[75826]: DEBUG cinder.volume.manager [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] thread info: [<_MainThread(MainThread, started 123559376887936)>, , , , , ] {{(pid=75826) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 10:51:03 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writing DB stats cinder:SELECT=1 {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:51:03 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writing DB stats cinder:UPDATE=1 {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:51:12 devstack cinder-volume[75826]: DEBUG oslo_service.periodic_task [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:51:12 devstack cinder-volume[75826]: DEBUG cinder.volume.drivers.lvm [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Updating volume stats {{(pid=75826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 10:51:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:51:12 devstack sudo[82304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 10:51:12 devstack sudo[82304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:51:12 devstack sudo[82304]: pam_unix(sudo:session): session closed for user root Sep 03 10:51:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:51:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:51:12 devstack sudo[82307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:51:12 devstack sudo[82307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:51:12 devstack sudo[82307]: pam_unix(sudo:session): session closed for user root Sep 03 10:51:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:51:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:51:12 devstack sudo[82310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:51:12 devstack sudo[82310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:51:13 devstack sudo[82310]: pam_unix(sudo:session): session closed for user root Sep 03 10:51:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:51:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:51:13 devstack sudo[82313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:51:13 devstack sudo[82313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:51:13 devstack sudo[82313]: pam_unix(sudo:session): session closed for user root Sep 03 10:51:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:51:13 devstack cinder-volume[75826]: DEBUG cinder.manager [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Notifying Schedulers of capabilities ... {{(pid=75826) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:51:13 devstack cinder-volume[75826]: DEBUG oslo_service.periodic_task [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running periodic task VolumeManager._thread_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:51:13 devstack cinder-volume[75826]: DEBUG cinder.volume.manager [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] thread count: 6 {{(pid=75826) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 10:51:13 devstack cinder-volume[75826]: DEBUG cinder.volume.manager [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] thread info: [<_MainThread(MainThread, started 123559376887936)>, , , , , ] {{(pid=75826) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 10:52:12 devstack cinder-volume[75826]: DEBUG oslo_service.periodic_task [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:52:12 devstack cinder-volume[75826]: DEBUG cinder.volume.drivers.lvm [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Updating volume stats {{(pid=75826) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 10:52:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:52:12 devstack sudo[84582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 10:52:12 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:52:12 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root Sep 03 10:52:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:52:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:52:12 devstack sudo[84585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:52:12 devstack sudo[84585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:52:12 devstack sudo[84585]: pam_unix(sudo:session): session closed for user root Sep 03 10:52:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:52:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:52:12 devstack sudo[84588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 10:52:12 devstack sudo[84588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:52:13 devstack sudo[84588]: pam_unix(sudo:session): session closed for user root Sep 03 10:52:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:52:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:52:13 devstack sudo[84601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 10:52:13 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:52:13 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root Sep 03 10:52:13 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:52:13 devstack cinder-volume[75826]: DEBUG cinder.manager [None req-a1568d65-03bd-4719-ae43-2d9c8c5b3e60 None None] Notifying Schedulers of capabilities ... {{(pid=75826) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:53:03 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writing DB stats cinder:SELECT=1 {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:53:03 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writing DB stats cinder:UPDATE=1 {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:53:11 devstack cinder-volume[75635]: INFO oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Caught SIGTERM, stopping children Sep 03 10:53:11 devstack cinder-volume[75635]: DEBUG oslo_concurrency.lockutils [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Acquiring lock "singleton_lock" {{(pid=75635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 10:53:11 devstack cinder-volume[75635]: DEBUG oslo_concurrency.lockutils [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Acquired lock "singleton_lock" {{(pid=75635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 10:53:11 devstack cinder-volume[75635]: DEBUG oslo_concurrency.lockutils [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Releasing lock "singleton_lock" {{(pid=75635) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 10:53:11 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Stop services. {{(pid=75635) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 10:53:11 devstack cinder-volume[75635]: DEBUG oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Killing children. {{(pid=75635) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 10:53:11 devstack cinder-volume[75635]: INFO oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Waiting on 1 children to exit Sep 03 10:53:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Acquiring lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 10:53:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Acquired lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 10:53:12 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Releasing lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 10:53:12 devstack cinder-volume[75826]: WARNING amqp [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 10:53:12 devstack cinder-volume[75826]: WARNING amqp [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 10:53:12 devstack cinder-volume[75635]: INFO oslo_service.backend._eventlet.service [None req-dd73fbc5-a43a-4aba-af3f-a98c5484ea40 None None] Child 75826 exited with status 0 Sep 03 10:53:12 devstack cinder-volume[85801]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 10:53:12 devstack cinder-volume[85801]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 10:53:12 devstack cinder-volume[85801]: we strongly recommend against using it for new projects. Sep 03 10:53:12 devstack cinder-volume[85801]: If you are already using Eventlet, we recommend migrating to a different Sep 03 10:53:12 devstack cinder-volume[85801]: framework. For more detail see Sep 03 10:53:12 devstack cinder-volume[85801]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 10:53:12 devstack cinder-volume[85801]: import eventlet # noqa Sep 03 10:53:14 devstack cinder-volume[85801]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 10:53:14 devstack cinder-volume[85801]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 10:53:14 devstack cinder-volume[85801]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 10:53:15 devstack cinder-volume[85801]: INFO dbcounter [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Registered counter for database cinder Sep 03 10:53:15 devstack cinder-volume[85801]: DEBUG oslo_db.sqlalchemy.engines [None req-9384224b-856c-443e-9180-bb7c47806379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:53:15 devstack cinder-volume[85801]: DEBUG dbcounter [-] [85801] Writer thread running {{(pid=85801) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 10:53:15 devstack cinder-volume[85801]: INFO cinder.rpc [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 10:53:15 devstack cinder-volume[85801]: INFO cinder.rpc [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 10:53:15 devstack cinder-volume[85801]: DEBUG oslo_db.sqlalchemy.engines [None req-9384224b-856c-443e-9180-bb7c47806379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:53:15 devstack cinder-volume[85801]: INFO cinder.volume.manager [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Determined volume DB was empty at startup. Sep 03 10:53:15 devstack cinder-volume[85801]: DEBUG cinder.volume.manager [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85801) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 10:53:15 devstack cinder-volume[85801]: INFO cinder.volume.manager [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 10:53:15 devstack cinder-volume[85801]: WARNING stevedore.named [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 10:53:15 devstack cinder-volume[85801]: WARNING castellan.key_manager [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 10:53:15 devstack cinder-volume[85801]: WARNING cinder.keymgr.conf_key_mgr [None req-9384224b-856c-443e-9180-bb7c47806379 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 10:53:15 devstack cinder-volume[85801]: INFO cinder.volume.manager [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 10:53:15 devstack cinder-volume[85801]: DEBUG oslo_db.sqlalchemy.engines [None req-9384224b-856c-443e-9180-bb7c47806379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85801) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:53:16 devstack cinder-volume[85801]: INFO oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Starting 1 workers Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Started child 86020 {{(pid=85801) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Full set of CONF: {{(pid=85801) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] ******************************************************************************** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Configuration options gathered from: {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] ================================================================================ {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] allow_availability_zone_fallback = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] allow_compression_on_image_upload = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] allowed_direct_url_schemes = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] api_rate_limit = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] auth_strategy = keystone {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_availability_zone = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[86020]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_host = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_stats_polling_interval = 60 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backup_api_class = cinder.backup.api.API {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backup_name_template = backup-%s {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backup_use_same_host = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backup_use_temp_snapshot = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] chap_password = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] chap_username = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cinder_internal_tenant_project_id = 7bb7b05108564871a90ff2badb223b4d {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cinder_internal_tenant_user_id = 88432713eb1d49ce8adcad707a34cd3d {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cluster = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] compression_format = gzip {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] compute_api_class = cinder.compute.nova.API {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] config_dir = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] config_source = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] control_exchange = openstack {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] debug = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] default_availability_zone = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] default_group_type = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] default_volume_type = QuobyteHD {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] disk_geometry = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] driver_client_cert = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] driver_client_cert_key = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] driver_data_namespace = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] driver_ssl_cert_path = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] driver_ssl_cert_verify = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] driver_use_ssl = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] enable_new_services = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] enable_unsupported_driver = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] enabled_backends = ['QuobyteHD'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] enforce_multipath_for_image_xfer = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] filter_function = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_api_insecure = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_api_servers = ['http://192.168.122.139/image'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_api_ssl_compression = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_ca_certificates_file = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_catalog_info = image:glance:publicURL {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_certfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_keyfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_num_retries = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance_request_timeout = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] goodness_function = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] graceful_shutdown_timeout = 5 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] group_api_class = cinder.group.api.API {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] host = devstack {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_compress_on_upload = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_conversion_address_space_limit = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_conversion_cpu_limit = 60 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_conversion_disable = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_upload_use_cinder_backend = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_upload_use_internal_tenant = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_volume_cache_enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_volume_cache_max_count = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] image_volume_cache_max_size_gb = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] init_host_max_objects_retrieval = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] instance_format = [instance: %(uuid)s] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] iscsi_target_flags = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] iscsi_write_cache = on {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] iser_helper = tgtadm {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] iser_ip_address = 192.168.122.139 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] iser_port = 3260 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] log_color = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] log_config_append = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] log_dir = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] log_file = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] log_options = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] log_rotate_interval = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] log_rotate_interval_type = days {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] log_rotation_type = none {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] max_age = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] max_logfile_count = 30 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] max_logfile_size_mb = 200 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] max_over_subscription_ratio = 20.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[86020]: INFO cinder.volume.manager [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.remotefs [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86020) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] message_reap_interval = 86400 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] message_ttl = 2592000 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] migration_create_volume_timeout_secs = 300 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] monkey_patch = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] monkey_patch_modules = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] my_ip = 192.168.122.139 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] no_snapshot_gb_quota = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] num_iser_scan_tries = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] num_shell_tries = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] num_volume_device_scan_tries = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] nvmeof_conn_info_version = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] nvmet_ns_id = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] nvmet_port_id = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] osapi_max_limit = 1000 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] osapi_volume_ext_list = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] osapi_volume_listen_port = 8776 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] osapi_volume_use_ssl = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] osapi_volume_workers = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] per_volume_size_limit = -1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] periodic_fuzzy_delay = 60 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] periodic_interval = 60 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] public_endpoint = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] publish_errors = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] quota_backup_gigabytes = 1000 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] quota_backups = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] quota_gigabytes = 1000 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] quota_groups = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] quota_snapshots = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] quota_volumes = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] rate_limit_burst = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] rate_limit_except_level = CRITICAL {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] rate_limit_interval = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] reinit_driver_count = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] replication_device = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] report_discard_supported = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] report_interval = 120 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] reservation_clean_interval = 86400 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] reservation_expire = 86400 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] reserved_image_namespaces = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] reserved_percentage = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] rpc_response_timeout = 120 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] run_external_periodic_tasks = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] scst_target_driver = iscsi {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] scst_target_iqn_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_down_time = 720 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] shell_completion = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] snapshot_name_template = snapshot-%s {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] split_loggers = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] state_path = /opt/stack/data/cinder {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] storage_availability_zone = nova {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] storage_protocol = iSCSI {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] syslog_log_facility = LOG_USER {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] target_helper = lioadm {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] target_ip_address = 192.168.122.139 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] target_port = 3260 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] target_protocol = iscsi {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] target_secondary_ip_addresses = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] trace_flags = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] transport_url = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] until_refresh = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] use_chap_auth = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] use_default_quota_class = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] use_journal = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] use_json = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] use_multipath_for_image_xfer = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] use_stderr = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] use_syslog = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] verify_glance_signatures = enabled {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_api_class = cinder.volume.api.API {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_backend_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_clear = zero {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_clear_ionice = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_clear_size = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_copy_bps_limit = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_dd_blocksize = 1M {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_name_template = volume-%s {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_service_inithost_offload = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volume_usage_audit_period = month {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] zoning_mode = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_concurrency.disable_process_locking = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.auth_section = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.auth_type = password {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.auth_version = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.cache = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.certfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.include_service_catalog = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.insecure = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.interface = public {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.keyfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_password = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcache_username = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.region_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.service_type = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.139/identity {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.backend = dogpile.cache.null {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.backend_argument = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.backend_expiration_time = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.config_prefix = cache.oslo {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.debug_cache_backend = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.enable_retry_client = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.enable_socket_keepalive = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.expiration_time = 600 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.hashclient_retry_attempts = 2 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.memcache_dead_retry = 300 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.memcache_pool_maxsize = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.memcache_sasl_enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.password = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.proxies = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.redis_db = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.redis_server = localhost:6379 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.retry_attempts = 2 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.retry_delay = 0.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.socket_keepalive_count = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.socket_keepalive_idle = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.socket_keepalive_interval = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.socket_timeout = 1.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.tls_allowed_ciphers = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86020) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 10:53:16 devstack cinder-volume[86020]: WARNING cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 10:53:16 devstack cinder-volume[86020]: WARNING cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.tls_cafile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.tls_certfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.tls_enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.tls_keyfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cache.username = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] coordination.backend_url = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.asyncio_connection = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.asyncio_slave_connection = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.backend = sqlalchemy {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.connection = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.connection_debug = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.connection_parameters = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.connection_recycle_time = 3600 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.connection_trace = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Running cmd (subprocess): mount.quobyte {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.db_inc_retry_interval = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.db_max_retries = 20 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.db_max_retry_interval = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.db_retry_interval = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.max_overflow = 50 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.max_pool_size = 5 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.max_retries = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.mysql_wsrep_sync_wait = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.pool_timeout = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.retry_interval = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.slave_connection = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.sqlite_synchronous = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.synchronous_reader = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] database.use_db_reconnect = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_tracing.insecure = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.connection_string = messaging:// {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.es_doc_type = notification {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.es_scroll_size = 10000 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.es_scroll_time = 2m {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.filter_error_trace = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.hmac_keys = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.sentinel_service_name = mymaster {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.socket_timeout = 0.1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.trace_requests = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler.trace_sqlalchemy = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler_jaeger.process_tags = {} {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler_jaeger.service_name_prefix = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] profiler_otlp.service_name_prefix = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.enforce_new_defaults = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.policy_default_rule = default {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.policy_file = policy.yaml {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] privsep_osbrick.group = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] privsep_osbrick.helper_command = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] privsep_osbrick.user = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cinder_sys_admin.group = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cinder_sys_admin.helper_command = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] cinder_sys_admin.user = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.auth_section = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.auth_type = password {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.cafile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.certfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.collect_timing = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.insecure = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.keyfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.send_service_user_token = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.split_loggers = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.timeout = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.tls_ciphers = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] service_user.tls_min_version = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.auth_section = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.auth_type = password {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.certfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.collect_timing = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.insecure = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.keyfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.region_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.split_loggers = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.timeout = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.tls_ciphers = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] glance.tls_min_version = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.backend_availability_zone = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.chap_password = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.chap_username = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.disk_geometry = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.driver_client_cert = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.driver_client_cert_key = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.driver_data_namespace = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.driver_use_ssl = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.extra_capabilities = {} {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.filter_function = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.goodness_function = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.iscsi_target_flags = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.iscsi_write_cache = on {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.iser_helper = tgtadm {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.iser_ip_address = 192.168.122.139 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.iser_port = 3260 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_host = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_login = admin {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_mount_options = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_password = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_private_key = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_share_path = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.num_shell_tries = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.quobyte_volume_url = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.replication_device = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.report_discard_supported = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.reserved_percentage = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.target_helper = tgtadm {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.target_ip_address = 192.168.122.139 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.target_port = 3260 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.target_protocol = iscsi {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.trace_flags = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.unique_fqdn_network = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.use_chap_auth = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.volume_backend_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.volume_clear = zero {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.volume_clear_ionice = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.volume_clear_size = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_reports.file_event_handler = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_reports.log_dir = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.backend_availability_zone = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.backend_host = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.chap_password = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.chap_username = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.chiscsi_conf = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.disk_geometry = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.driver_client_cert = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.driver_data_namespace = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.driver_use_ssl = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.extra_capabilities = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.filter_function = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.goodness_function = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.iser_helper = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.iser_ip_address = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.iser_port = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.iser_target_prefix = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_host = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_login = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_mount_options = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_password = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_private_key = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_share_path = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_ssh_port = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.num_shell_tries = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.nvmet_port_id = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.replication_device = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.report_discard_supported = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.reserved_percentage = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.scst_target_driver = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.storage_protocol = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.target_helper = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.target_ip_address = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.target_port = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.target_prefix = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.target_protocol = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.trace_flags = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.use_chap_auth = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.volume_clear = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.volume_clear_size = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] QuobyteHD.volumes_dir = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack quobyte-client[86023]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.ssl = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack quobyte-client[86023]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_notifications.driver = [] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_notifications.retry = -1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] key_manager.fixed_key = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.barbican_api_version = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.barbican_endpoint = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.barbican_endpoint_type = public {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.barbican_region_name = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.cafile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.certfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.collect_timing = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.insecure = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.keyfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.number_of_retries = 60 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.retry_delay = 1 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.send_service_user_token = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.split_loggers = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.timeout = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.tls_ciphers = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.tls_min_version = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.verify_ssl = True {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican.verify_ssl_path = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.auth_section = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.auth_type = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.cafile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] CMD "mount.quobyte" returned: 1 in 0.148s {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.certfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.collect_timing = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.insecure = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.keyfile = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.split_loggers = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.timeout = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.tls_ciphers = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] barbican_service_user.tls_min_version = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.approle_role_id = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.approle_secret_id = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.auth_method = approle {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.auth_path = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.kv_mountpoint = secret {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.kv_path = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.kv_version = 2 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.namespace = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.root_token_id = **** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.ssl_ca_crt_file = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.timeout = 60.0 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.token_file = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.token_role = None {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.use_ssl = False {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[86020]: INFO cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 ... Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:16 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] ******************************************************************************** {{(pid=85801) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 -c /etc/quobyte/client-cinder.cfg {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:16 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 -c /etc/quobyte/client-cinder.cfg Sep 03 10:53:16 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:53:16 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.384s {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:16 devstack cinder-volume[86020]: INFO cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 succeeded Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.402s {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:53:16 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:16 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:53:16 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:53:17 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.244s {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:17 devstack cinder-volume[86020]: INFO cinder.volume.driver [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.volume.driver [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8575019836426, 'free_capacity_gb': 1773.8575019836426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86020) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_db.sqlalchemy.engines [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86020) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG dbcounter [-] [86020] Writer thread running {{(pid=86020) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.db.api [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Building query based on filter {{(pid=86020) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.image.image_utils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86020) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 10:53:17 devstack cinder-volume[86020]: INFO cinder.keymgr.migration [None req-3aa23efb-782d-472c-8a30-4155b30c533b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:17 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:53:17 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:53:17 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.250s {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.manager [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Notifying Schedulers of capabilities ... {{(pid=86020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:53:17 devstack cinder-volume[86020]: INFO cinder.volume.manager [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Driver initialization completed successfully. Sep 03 10:53:17 devstack cinder-volume[86020]: INFO cinder.manager [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Initiating service 3 cleanup Sep 03 10:53:17 devstack cinder-volume[86020]: INFO cinder.manager [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Service 3 cleanup completed. Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.service [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Creating RPC server for service cinder-volume {{(pid=86020) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.service [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86020) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 10:53:17 devstack cinder-volume[86020]: INFO cinder.volume.manager [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.quobyte [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:17 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:53:17 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:53:17 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Sep 03 10:53:17 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.261s {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:17 devstack cinder-volume[86020]: INFO cinder.volume.manager [None req-96ad92f6-f739-4a99-b313-893fc3983df8 None None] Driver post RPC initialization completed successfully. Sep 03 10:53:22 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-6ef28132-9526-489d-ba5c-9cb2efb7eec9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:53:22 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-6ef28132-9526-489d-ba5c-9cb2efb7eec9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:53:22 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.quobyte [None req-6ef28132-9526-489d-ba5c-9cb2efb7eec9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:53:22 devstack cinder-volume[86020]: DEBUG cinder.volume.drivers.quobyte [None req-6ef28132-9526-489d-ba5c-9cb2efb7eec9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:53:22 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-6ef28132-9526-489d-ba5c-9cb2efb7eec9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86020) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:53:22 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-6ef28132-9526-489d-ba5c-9cb2efb7eec9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:22 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:53:22 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:53:22 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Sep 03 10:53:22 devstack cinder-volume[86020]: DEBUG oslo_concurrency.processutils [None req-6ef28132-9526-489d-ba5c-9cb2efb7eec9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.238s {{(pid=86020) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:22 devstack cinder-volume[86020]: DEBUG cinder.manager [None req-6ef28132-9526-489d-ba5c-9cb2efb7eec9 None None] Notifying Schedulers of capabilities ... {{(pid=86020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:53:23 devstack cinder-volume[85801]: INFO oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Caught SIGTERM, stopping children Sep 03 10:53:23 devstack cinder-volume[85801]: DEBUG oslo_concurrency.lockutils [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Acquiring lock "singleton_lock" {{(pid=85801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 10:53:23 devstack cinder-volume[85801]: DEBUG oslo_concurrency.lockutils [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Acquired lock "singleton_lock" {{(pid=85801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 10:53:23 devstack cinder-volume[85801]: DEBUG oslo_concurrency.lockutils [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Releasing lock "singleton_lock" {{(pid=85801) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 10:53:23 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Stop services. {{(pid=85801) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 10:53:23 devstack cinder-volume[85801]: DEBUG oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Killing children. {{(pid=85801) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 10:53:23 devstack cinder-volume[85801]: INFO oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Waiting on 1 children to exit Sep 03 10:53:25 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Acquiring lock "singleton_lock" {{(pid=86020) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 10:53:25 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Acquired lock "singleton_lock" {{(pid=86020) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 10:53:25 devstack cinder-volume[86020]: DEBUG oslo_concurrency.lockutils [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Releasing lock "singleton_lock" {{(pid=86020) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 10:53:25 devstack cinder-volume[86020]: WARNING amqp [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 10:53:25 devstack cinder-volume[86020]: WARNING amqp [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 10:53:25 devstack cinder-volume[85801]: INFO oslo_service.backend._eventlet.service [None req-9384224b-856c-443e-9180-bb7c47806379 None None] Child 86020 exited with status 0 Sep 03 10:53:26 devstack cinder-volume[86303]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 10:53:26 devstack cinder-volume[86303]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 10:53:26 devstack cinder-volume[86303]: we strongly recommend against using it for new projects. Sep 03 10:53:26 devstack cinder-volume[86303]: If you are already using Eventlet, we recommend migrating to a different Sep 03 10:53:26 devstack cinder-volume[86303]: framework. For more detail see Sep 03 10:53:26 devstack cinder-volume[86303]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 10:53:26 devstack cinder-volume[86303]: import eventlet # noqa Sep 03 10:53:29 devstack cinder-volume[86303]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 10:53:29 devstack cinder-volume[86303]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 10:53:29 devstack cinder-volume[86303]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 10:53:30 devstack cinder-volume[86303]: INFO dbcounter [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Registered counter for database cinder Sep 03 10:53:30 devstack cinder-volume[86303]: DEBUG oslo_db.sqlalchemy.engines [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:53:30 devstack cinder-volume[86303]: DEBUG dbcounter [-] [86303] Writer thread running {{(pid=86303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 10:53:30 devstack cinder-volume[86303]: INFO cinder.rpc [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 10:53:30 devstack cinder-volume[86303]: INFO cinder.rpc [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 10:53:30 devstack cinder-volume[86303]: DEBUG oslo_db.sqlalchemy.engines [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:53:31 devstack cinder-volume[86303]: INFO cinder.volume.manager [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Determined volume DB was empty at startup. Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG cinder.volume.manager [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86303) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 10:53:31 devstack cinder-volume[86303]: WARNING stevedore.named [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 10:53:31 devstack cinder-volume[86303]: WARNING castellan.key_manager [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 10:53:31 devstack cinder-volume[86303]: WARNING cinder.keymgr.conf_key_mgr [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 10:53:31 devstack cinder-volume[86303]: INFO cinder.volume.manager [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_db.sqlalchemy.engines [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:53:31 devstack cinder-volume[86303]: INFO oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Starting 1 workers Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Started child 86603 {{(pid=86303) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Full set of CONF: {{(pid=86303) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] ******************************************************************************** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] Configuration options gathered from: {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] ================================================================================ {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] allow_availability_zone_fallback = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86603]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] allow_compression_on_image_upload = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] allowed_direct_url_schemes = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] api_rate_limit = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] auth_strategy = keystone {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_availability_zone = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_host = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_stats_polling_interval = 60 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backup_api_class = cinder.backup.api.API {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backup_name_template = backup-%s {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backup_use_same_host = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backup_use_temp_snapshot = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] chap_password = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] chap_username = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cinder_internal_tenant_project_id = 7bb7b05108564871a90ff2badb223b4d {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cinder_internal_tenant_user_id = 88432713eb1d49ce8adcad707a34cd3d {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cluster = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] compression_format = gzip {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] compute_api_class = cinder.compute.nova.API {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] config_dir = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] config_source = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] control_exchange = openstack {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] debug = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] default_availability_zone = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] default_group_type = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] default_volume_type = QuobyteHD {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] disk_geometry = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] driver_client_cert = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] driver_client_cert_key = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] driver_data_namespace = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] driver_ssl_cert_path = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] driver_ssl_cert_verify = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] driver_use_ssl = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] enable_new_services = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] enable_unsupported_driver = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] enabled_backends = ['QuobyteHD'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] enforce_multipath_for_image_xfer = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] filter_function = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_api_insecure = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_api_servers = ['http://192.168.122.139/image'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_api_ssl_compression = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_ca_certificates_file = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_catalog_info = image:glance:publicURL {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_certfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_keyfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_num_retries = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance_request_timeout = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] goodness_function = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] graceful_shutdown_timeout = 5 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] group_api_class = cinder.group.api.API {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] host = devstack {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_compress_on_upload = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_conversion_address_space_limit = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_conversion_cpu_limit = 60 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_conversion_disable = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_upload_use_cinder_backend = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_upload_use_internal_tenant = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_volume_cache_enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_volume_cache_max_count = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] image_volume_cache_max_size_gb = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] init_host_max_objects_retrieval = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] instance_format = [instance: %(uuid)s] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] iscsi_target_flags = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] iscsi_write_cache = on {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] iser_helper = tgtadm {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] iser_ip_address = 192.168.122.139 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] iser_port = 3260 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] log_color = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] log_config_append = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] log_dir = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] log_file = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] log_options = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] log_rotate_interval = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] log_rotate_interval_type = days {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] log_rotation_type = none {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] max_age = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] max_logfile_count = 30 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] max_logfile_size_mb = 200 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] max_over_subscription_ratio = 20.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] message_reap_interval = 86400 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] message_ttl = 2592000 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] migration_create_volume_timeout_secs = 300 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] monkey_patch = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] monkey_patch_modules = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] my_ip = 192.168.122.139 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] no_snapshot_gb_quota = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] num_iser_scan_tries = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] num_shell_tries = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] num_volume_device_scan_tries = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] nvmeof_conn_info_version = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] nvmet_ns_id = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] nvmet_port_id = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] osapi_max_limit = 1000 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] osapi_volume_ext_list = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] osapi_volume_listen_port = 8776 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] osapi_volume_use_ssl = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] osapi_volume_workers = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86603) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] per_volume_size_limit = -1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] periodic_fuzzy_delay = 60 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] periodic_interval = 60 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] public_endpoint = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] publish_errors = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] quota_backup_gigabytes = 1000 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] quota_backups = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] quota_gigabytes = 1000 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] quota_groups = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] quota_snapshots = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] quota_volumes = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] rate_limit_burst = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] rate_limit_except_level = CRITICAL {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] rate_limit_interval = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] reinit_driver_count = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] replication_device = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] report_discard_supported = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] report_interval = 120 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] reservation_clean_interval = 86400 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] reservation_expire = 86400 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] reserved_image_namespaces = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] reserved_percentage = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] rpc_response_timeout = 120 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] run_external_periodic_tasks = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] scst_target_driver = iscsi {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] scst_target_iqn_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_down_time = 720 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] shell_completion = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] snapshot_name_template = snapshot-%s {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] split_loggers = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] state_path = /opt/stack/data/cinder {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] storage_availability_zone = nova {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] storage_protocol = iSCSI {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] syslog_log_facility = LOG_USER {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] target_helper = lioadm {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] target_ip_address = 192.168.122.139 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] target_port = 3260 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] target_protocol = iscsi {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] target_secondary_ip_addresses = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] trace_flags = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] transport_url = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] until_refresh = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] use_chap_auth = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] use_default_quota_class = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] use_journal = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] use_json = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] use_multipath_for_image_xfer = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] use_stderr = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] use_syslog = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] verify_glance_signatures = enabled {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_api_class = cinder.volume.api.API {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_backend_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_clear = zero {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_clear_ionice = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_clear_size = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_copy_bps_limit = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_dd_blocksize = 1M {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_name_template = volume-%s {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_service_inithost_offload = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volume_usage_audit_period = month {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] zoning_mode = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_concurrency.disable_process_locking = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.auth_section = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.auth_type = password {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.auth_version = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.cache = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.certfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.include_service_catalog = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.insecure = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.interface = public {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.keyfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_password = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcache_username = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.region_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.service_type = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.139/identity {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.backend = dogpile.cache.null {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.backend_argument = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.backend_expiration_time = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.config_prefix = cache.oslo {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.debug_cache_backend = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.enable_retry_client = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.enable_socket_keepalive = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.expiration_time = 600 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.hashclient_retry_attempts = 2 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.memcache_dead_retry = 300 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.memcache_pool_maxsize = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.memcache_sasl_enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.password = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.proxies = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.redis_db = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.redis_server = localhost:6379 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.retry_attempts = 2 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.retry_delay = 0.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.socket_keepalive_count = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.socket_keepalive_idle = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.socket_keepalive_interval = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.socket_timeout = 1.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.tls_allowed_ciphers = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.tls_cafile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.tls_certfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.tls_enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.tls_keyfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cache.username = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] coordination.backend_url = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86603) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 10:53:31 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.quobyte [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 10:53:31 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.quobyte [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.asyncio_connection = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.asyncio_slave_connection = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.backend = sqlalchemy {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.connection = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Running cmd (subprocess): mount.quobyte {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.connection_debug = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.connection_parameters = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.connection_recycle_time = 3600 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.connection_trace = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.db_inc_retry_interval = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.db_max_retries = 20 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.db_max_retry_interval = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.db_retry_interval = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.max_overflow = 50 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.max_pool_size = 5 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.max_retries = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.mysql_wsrep_sync_wait = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.pool_timeout = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.retry_interval = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.slave_connection = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.sqlite_synchronous = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.synchronous_reader = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] database.use_db_reconnect = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_tracing.insecure = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.connection_string = messaging:// {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.es_doc_type = notification {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.es_scroll_size = 10000 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.es_scroll_time = 2m {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.filter_error_trace = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.hmac_keys = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.sentinel_service_name = mymaster {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.socket_timeout = 0.1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.trace_requests = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler.trace_sqlalchemy = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler_jaeger.process_tags = {} {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler_jaeger.service_name_prefix = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] profiler_otlp.service_name_prefix = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.enforce_new_defaults = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.policy_default_rule = default {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.policy_file = policy.yaml {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] privsep_osbrick.group = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] privsep_osbrick.helper_command = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] privsep_osbrick.user = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cinder_sys_admin.group = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cinder_sys_admin.helper_command = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] cinder_sys_admin.user = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.auth_section = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.auth_type = password {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.cafile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.certfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.collect_timing = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.insecure = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.keyfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.send_service_user_token = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.split_loggers = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.timeout = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.tls_ciphers = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] service_user.tls_min_version = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.auth_section = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.auth_type = password {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.certfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.collect_timing = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.insecure = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.keyfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.region_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.split_loggers = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.timeout = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.tls_ciphers = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] glance.tls_min_version = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.backend_availability_zone = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.chap_password = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.chap_username = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.disk_geometry = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.driver_client_cert = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.driver_client_cert_key = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.driver_data_namespace = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.driver_use_ssl = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.extra_capabilities = {} {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.filter_function = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.goodness_function = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.iscsi_target_flags = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.iscsi_write_cache = on {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.iser_helper = tgtadm {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.iser_ip_address = 192.168.122.139 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.iser_port = 3260 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_host = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_login = admin {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_mount_options = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_password = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_private_key = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_share_path = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.num_shell_tries = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.quobyte_volume_url = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.replication_device = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.report_discard_supported = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.reserved_percentage = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.target_helper = tgtadm {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.target_ip_address = 192.168.122.139 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.target_port = 3260 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.target_protocol = iscsi {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.trace_flags = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.unique_fqdn_network = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.use_chap_auth = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.volume_backend_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.volume_clear = zero {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.volume_clear_ionice = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.volume_clear_size = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_reports.file_event_handler = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_reports.log_dir = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.backend_availability_zone = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.backend_host = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.chap_password = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.chap_username = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.chiscsi_conf = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.disk_geometry = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.driver_client_cert = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack quobyte-client[86604]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.driver_data_namespace = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.driver_use_ssl = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack quobyte-client[86604]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.extra_capabilities = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.filter_function = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.goodness_function = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] CMD "mount.quobyte" returned: 1 in 0.102s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.iser_helper = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.iser_ip_address = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.iser_port = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.iser_target_prefix = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_host = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_login = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_mount_options = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_password = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_private_key = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_share_path = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_ssh_port = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.num_shell_tries = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.nvmet_port_id = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.replication_device = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.report_discard_supported = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.reserved_percentage = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.scst_target_driver = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.storage_protocol = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.target_helper = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.target_ip_address = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.target_port = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.target_prefix = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.target_protocol = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.trace_flags = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.use_chap_auth = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.volume_clear = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.volume_clear_size = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] QuobyteHD.volumes_dir = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.ssl = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_notifications.driver = [] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_notifications.retry = -1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] key_manager.fixed_key = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.barbican_api_version = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.barbican_endpoint = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.barbican_endpoint_type = public {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.barbican_region_name = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.cafile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.certfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.collect_timing = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.insecure = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.keyfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.number_of_retries = 60 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.retry_delay = 1 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.send_service_user_token = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.split_loggers = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.timeout = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.tls_ciphers = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.tls_min_version = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.verify_ssl = True {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican.verify_ssl_path = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.auth_section = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.auth_type = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.cafile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.certfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.collect_timing = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.insecure = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.keyfile = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.split_loggers = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.timeout = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.tls_ciphers = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] barbican_service_user.tls_min_version = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.approle_role_id = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.approle_secret_id = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.auth_method = approle {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.auth_path = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.kv_mountpoint = secret {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.kv_path = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.kv_version = 2 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.namespace = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.root_token_id = **** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.ssl_ca_crt_file = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.timeout = 60.0 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.token_file = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.token_role = None {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.use_ssl = False {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 10:53:31 devstack cinder-volume[86303]: DEBUG oslo_service.backend._eventlet.service [None req-0a67ce95-9ca3-47ee-8b4a-2a5d1073f552 None None] ******************************************************************************** {{(pid=86303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 10:53:31 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:53:31 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.270s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:31 devstack cinder-volume[86603]: INFO cinder.volume.driver [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Driver hasn't implemented _init_vendor_properties() Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG cinder.volume.driver [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8575019836426, 'free_capacity_gb': 1773.8575019836426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86603) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_db.sqlalchemy.engines [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86603) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writer thread running {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG cinder.db.api [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Building query based on filter {{(pid=86603) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86603) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:53:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:31 devstack cinder-volume[86603]: INFO cinder.keymgr.migration [None req-ad2d14cf-850d-4652-b08e-d8e56ce7daf3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 10:53:31 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:53:31 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:53:32 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.234s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:53:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Driver initialization completed successfully. Sep 03 10:53:32 devstack cinder-volume[86603]: INFO cinder.manager [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Initiating service 3 cleanup Sep 03 10:53:32 devstack cinder-volume[86603]: INFO cinder.manager [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Service 3 cleanup completed. Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG cinder.service [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Creating RPC server for service cinder-volume {{(pid=86603) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG cinder.service [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86603) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 10:53:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:53:32 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:53:32 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:53:32 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Sep 03 10:53:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.239s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:53:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e57993a4-b949-4072-9cb2-8a3bf638269b None None] Driver post RPC initialization completed successfully. Sep 03 10:53:41 devstack cinder-volume[86303]: DEBUG dbcounter [-] [86303] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:53:42 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:53:42 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=3 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:54:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:54:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 6 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 10:54:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 10:54:30 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Flow 'volume_create_manager' (53b329fc-cea5-4d85-9ed7-2f21e4ac3d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6cfa38-3d49-4eb7-a474-149cb8462070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6cfa38-3d49-4eb7-a474-149cb8462070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1351298043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0006db0-84ee-4fe6-b7f8-bb075a097c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483a38130a6d4958b324c87c8872b57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:54:31Z,use_quota=True,user_id='269ee66213934c59a309edf25d6143d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dce3013-95d9-4ad6-affd-75507d159865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dce3013-95d9-4ad6-affd-75507d159865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3587ac49-b0ba-452a-a14a-48ab9875f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3587ac49-b0ba-452a-a14a-48ab9875f791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0006db0-84ee-4fe6-b7f8-bb075a097c34', 'volume_name': 'volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dd0284-544f-4db7-862d-de567aa30944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22dd0284-544f-4db7-862d-de567aa30944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e77a1f0-3698-4233-b2e8-1e519421a3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:54:31 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Volume f0006db0-84ee-4fe6-b7f8-bb075a097c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34', 'volume_size': 1} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1351298043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0006db0-84ee-4fe6-b7f8-bb075a097c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483a38130a6d4958b324c87c8872b57d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:54:31Z,use_quota=True,user_id='269ee66213934c59a309edf25d6143d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Creating volume f0006db0-84ee-4fe6-b7f8-bb075a097c34 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:54:31 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:54:31 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 1073741824 Sep 03 10:54:31 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:54:31 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 1073741824" returned: 0 in 0.624s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:54:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:54:31 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 Sep 03 10:54:31 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:54:32 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Sep 03 10:54:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34" returned: 0 in 0.266s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:54:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:54:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:54:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e77a1f0-3698-4233-b2e8-1e519421a3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:54:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef2e6ae-843f-475b-b0ac-47b18d535dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:54:32 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Volume volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 (f0006db0-84ee-4fe6-b7f8-bb075a097c34): created successfully Sep 03 10:54:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef2e6ae-843f-475b-b0ac-47b18d535dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:54:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Flow 'volume_create_manager' (53b329fc-cea5-4d85-9ed7-2f21e4ac3d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:54:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1f2c548f-30d4-4d5c-b7cf-9752da4942c4 tempest-TaggedAttachmentsTest-137868570 None] Created volume successfully. Sep 03 10:54:42 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:54:42 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:55:01 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:55:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Flow 'volume_create_manager' (25258470-8125-4b49-85f6-45da1eef1648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:55:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee3cae9-6e1a-4318-b8b1-96964bd44f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee3cae9-6e1a-4318-b8b1-96964bd44f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1783458478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a236eea5-ff7f-410f-aea5-b08ce7ea0885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9530796232e4e7395fcfaf6661f5852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:55:02Z,use_quota=True,user_id='3f7375754458494a974a4813fa69ef8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514060a3-d9fe-43cc-8b63-2ad9602de660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514060a3-d9fe-43cc-8b63-2ad9602de660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f41e2e-64ec-4ddc-9343-42246dea71cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f41e2e-64ec-4ddc-9343-42246dea71cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a236eea5-ff7f-410f-aea5-b08ce7ea0885', 'volume_name': 'volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615c40f8-684b-44fd-a2f9-60f8fc6b053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615c40f8-684b-44fd-a2f9-60f8fc6b053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d488945-fce9-4014-8534-800387f7f18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:02 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Volume a236eea5-ff7f-410f-aea5-b08ce7ea0885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885', 'volume_size': 1} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1783458478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a236eea5-ff7f-410f-aea5-b08ce7ea0885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9530796232e4e7395fcfaf6661f5852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:55:02Z,use_quota=True,user_id='3f7375754458494a974a4813fa69ef8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Creating volume a236eea5-ff7f-410f-aea5-b08ce7ea0885 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:55:02 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:55:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:02 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 1073741824 Sep 03 10:55:02 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:03 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 1073741824" returned: 0 in 1.057s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:03 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 Sep 03 10:55:03 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:03 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885" returned: 0 in 0.490s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:55:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d488945-fce9-4014-8534-800387f7f18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b708b5e-22ea-4eaa-a25d-8ef829901acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:03 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Volume volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 (a236eea5-ff7f-410f-aea5-b08ce7ea0885): created successfully Sep 03 10:55:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b708b5e-22ea-4eaa-a25d-8ef829901acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Flow 'volume_create_manager' (25258470-8125-4b49-85f6-45da1eef1648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:55:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3dbeb1ee-e8c1-4a3c-88f5-2a3cc64959ec tempest-VolumesAdminNegativeTest-1298115509 None] Created volume successfully. Sep 03 10:55:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Acquiring lock "cinder-a236eea5-ff7f-410f-aea5-b08ce7ea0885-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:55:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Lock "cinder-a236eea5-ff7f-410f-aea5-b08ce7ea0885-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:55:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Acquiring lock "cinder-quobyte-a236eea5-ff7f-410f-aea5-b08ce7ea0885" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:55:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Lock "cinder-quobyte-a236eea5-ff7f-410f-aea5-b08ce7ea0885" acquired by "delete_volume" :: waited 0.053s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:55:05 devstack cinder-volume[86603]: INFO oslo.privsep.daemon [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpktzm8vsy/privsep.sock'] Sep 03 10:55:05 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpktzm8vsy/privsep.sock Sep 03 10:55:05 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:07 devstack cinder-volume[86603]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 03 10:55:07 devstack cinder-volume[86603]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 10:55:07 devstack cinder-volume[86603]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 03 10:55:07 devstack cinder-volume[86603]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 10:55:07 devstack cinder-volume[86603]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 03 10:55:07 devstack cinder-volume[86603]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 03 10:55:07 devstack cinder-volume[86603]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 10:55:07 devstack cinder-volume[86603]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 10:55:07 devstack cinder-volume[86603]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 03 10:55:07 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:07 devstack cinder-volume[86603]: INFO oslo.privsep.daemon [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Spawned new privsep daemon via rootwrap Sep 03 10:55:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Accepted privsep connection to /tmp/tmpktzm8vsy/privsep.sock {{(pid=86603) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 03 10:55:07 devstack cinder-volume[86603]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 03 10:55:07 devstack cinder-volume[86603]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 03 10:55:07 devstack cinder-volume[86603]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 03 10:55:07 devstack cinder-volume[86603]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87787 Sep 03 10:55:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad66cf-cf25-4c7c-961d-f91fd0adf933]: (2,) {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:55:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7d80dd-f20c-4e23-8543-f8eb93d8b253]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:55:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:08 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 Sep 03 10:55:08 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:08 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885" returned: 0 in 0.732s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:08 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885 Sep 03 10:55:08 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:09 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a236eea5-ff7f-410f-aea5-b08ce7ea0885" returned: 0 in 0.537s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Lock "cinder-quobyte-a236eea5-ff7f-410f-aea5-b08ce7ea0885" released by "delete_volume" :: held 3.872s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:55:09 devstack cinder-volume[86603]: WARNING cinder.quota [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:55:09 devstack cinder-volume[86603]: WARNING cinder.quota [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Created reservations ['6af35126-7045-4aef-ade8-24519adf45eb', 'a617ffa4-7632-404a-9f09-4925f5c92305', 'e0e14ecf-8bee-44fe-ae01-f3e0339c3b17', '7578ef7e-ad5c-45c1-870e-f58e17cd637d'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:09 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:55:09 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:09 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.373s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:55:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Deleted volume successfully. Sep 03 10:55:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-77e296d2-deb0-4e2f-b100-95480b49476d tempest-VolumesAdminNegativeTest-1298115509 None] Lock "cinder-a236eea5-ff7f-410f-aea5-b08ce7ea0885-delete_volume" released by "delete_volume" :: held 4.726s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:55:19 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:55:19 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=12,cinder:SELECT=5,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Flow 'volume_create_manager' (fd0d13e0-e568-47c5-8d70-39c18c603291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ca94da-5dcc-49cf-9715-625c9cef129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ca94da-5dcc-49cf-9715-625c9cef129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-330289813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a66318b76f4f41ac1c6dcdf8fe24f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:55:21Z,use_quota=True,user_id='37821390290849ea95aaab2d5262981f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20040974-a944-40bd-b6e8-1551151d338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20040974-a944-40bd-b6e8-1551151d338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb27c3b8-4467-4ab5-a0ca-225a8779524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb27c3b8-4467-4ab5-a0ca-225a8779524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1', 'volume_name': 'volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fe65fd-3368-4967-b93f-d419d02eb2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fe65fd-3368-4967-b93f-d419d02eb2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798e8740-3421-4308-9581-f03e011a1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:20 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Volume 3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1', 'volume_size': 1} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-330289813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a66318b76f4f41ac1c6dcdf8fe24f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:55:21Z,use_quota=True,user_id='37821390290849ea95aaab2d5262981f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Creating volume 3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:55:20 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:55:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:21 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 1073741824 Sep 03 10:55:21 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:21 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 1073741824" returned: 0 in 0.553s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:21 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 Sep 03 10:55:21 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:21 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1" returned: 0 in 0.297s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:55:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798e8740-3421-4308-9581-f03e011a1906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97173cd-736f-42ca-98f6-3e01cbb07041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:21 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Volume volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 (3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1): created successfully Sep 03 10:55:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97173cd-736f-42ca-98f6-3e01cbb07041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Flow 'volume_create_manager' (fd0d13e0-e568-47c5-8d70-39c18c603291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:55:21 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b3602f56-af2b-48d5-b306-a97b6f71eb46 tempest-ServerActionsTestOtherA-1983634105 None] Created volume successfully. Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:23 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:55:23 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:23 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.329s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 8 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 10:55:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 10:55:31 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:55:31 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Flow 'volume_create_manager' (46197ab5-9bf7-4958-831e-1021998cddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb61493-1fb8-4937-a45b-ba77bd480a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb61493-1fb8-4937-a45b-ba77bd480a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-81226158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1282945595148d4bd06daf9529bf053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:55:36Z,use_quota=True,user_id='b5e2c7b9b749466ea40c678ff4c9f113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b13cae-3935-446c-be81-56a926c4958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b13cae-3935-446c-be81-56a926c4958f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becf14f0-0634-403d-8bb1-ee0982841562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becf14f0-0634-403d-8bb1-ee0982841562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5', 'volume_name': 'volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce3c91d-f17d-410c-a969-a1bb72a085fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce3c91d-f17d-410c-a969-a1bb72a085fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93d364a-fd91-4d24-a926-cdf940c0e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:36 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Volume c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5', 'volume_size': 1} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-81226158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1282945595148d4bd06daf9529bf053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:55:36Z,use_quota=True,user_id='b5e2c7b9b749466ea40c678ff4c9f113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Creating volume c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:55:36 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:55:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:36 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 1073741824 Sep 03 10:55:36 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:37 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 1073741824" returned: 0 in 0.593s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:37 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 Sep 03 10:55:37 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:37 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5" returned: 0 in 0.418s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:55:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93d364a-fd91-4d24-a926-cdf940c0e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfc629a-d269-4630-b255-c98a4e15b7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:55:37 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Volume volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 (c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5): created successfully Sep 03 10:55:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfc629a-d269-4630-b255-c98a4e15b7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:55:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Flow 'volume_create_manager' (46197ab5-9bf7-4958-831e-1021998cddb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:55:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-029f9a76-edf7-4501-9cd6-2ab75f2cd908 tempest-DeleteServersTestJSON-727745736 None] Created volume successfully. Sep 03 10:55:42 devstack cinder-volume[86603]: WARNING py.warnings [req-96ba7b0c-6d73-4f24-a7f1-af7e4c6fb2f2 req-14bc3fbb-f2dc-4791-8310-4453a7d54a90 tempest-DeleteServersTestJSON-727745736 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 03 10:55:42 devstack cinder-volume[86603]: .first() Sep 03 10:55:42 devstack cinder-volume[86603]: Sep 03 10:55:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-96ba7b0c-6d73-4f24-a7f1-af7e4c6fb2f2 req-14bc3fbb-f2dc-4791-8310-4453a7d54a90 tempest-DeleteServersTestJSON-727745736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-96ba7b0c-6d73-4f24-a7f1-af7e4c6fb2f2 req-14bc3fbb-f2dc-4791-8310-4453a7d54a90 tempest-DeleteServersTestJSON-727745736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-96ba7b0c-6d73-4f24-a7f1-af7e4c6fb2f2 req-14bc3fbb-f2dc-4791-8310-4453a7d54a90 tempest-DeleteServersTestJSON-727745736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-96ba7b0c-6d73-4f24-a7f1-af7e4c6fb2f2 req-14bc3fbb-f2dc-4791-8310-4453a7d54a90 tempest-DeleteServersTestJSON-727745736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8e58bb9-d386-4b15-aa8b-03fc36ad5aa1', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 10:55:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-96ba7b0c-6d73-4f24-a7f1-af7e4c6fb2f2 req-14bc3fbb-f2dc-4791-8310-4453a7d54a90 tempest-DeleteServersTestJSON-727745736 None] attachment_update completed successfully. Sep 03 10:55:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-6ccb587a-08d2-4c4c-9447-912a4d065680 req-64494430-fe38-407e-8b2f-2a79c5d2a938 tempest-DeleteServersTestJSON-727745736 None] Terminate volume connection completed successfully. Sep 03 10:55:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-6ccb587a-08d2-4c4c-9447-912a4d065680 req-64494430-fe38-407e-8b2f-2a79c5d2a938 tempest-DeleteServersTestJSON-727745736 None] Deleting attachment b8e58bb9-d386-4b15-aa8b-03fc36ad5aa1. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:55:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Acquiring lock "cinder-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:55:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Lock "cinder-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:55:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Acquiring lock "cinder-quobyte-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:55:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Lock "cinder-quobyte-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5" acquired by "delete_volume" :: waited 0.059s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:55:52 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d903d8-f817-4c5e-8f0e-fd8467f45048]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:55:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:52 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 Sep 03 10:55:52 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:52 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5" returned: 0 in 0.684s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:52 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5 Sep 03 10:55:52 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:53 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5" returned: 0 in 0.319s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Lock "cinder-quobyte-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5" released by "delete_volume" :: held 1.106s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Created reservations ['301e9e68-80c4-4cc3-97a6-5f5fc86a8826', '107db5a6-61cb-4a28-b85d-efc20e013b04', '666c0af6-a4d3-46ca-9aa5-85f3cba8dd87', '020b8d03-97cb-4912-aec5-e6f279d38d95'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:55:53 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:55:53 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:55:53 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.337s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:55:53 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Deleted volume successfully. Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a40974c0-e45e-4a6d-9e4f-bba0b793cece tempest-DeleteServersTestJSON-727745736 None] Lock "cinder-c4d46ae1-55f4-49b4-b6c3-0c3ccf24b7d5-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-c5966125-5d0e-4c87-bbc4-24cbaa2ff9cc req-3e370298-a4a4-450e-9775-95b539635c00 tempest-TaggedAttachmentsTest-137868570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-c5966125-5d0e-4c87-bbc4-24cbaa2ff9cc req-3e370298-a4a4-450e-9775-95b539635c00 tempest-TaggedAttachmentsTest-137868570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-c5966125-5d0e-4c87-bbc4-24cbaa2ff9cc req-3e370298-a4a4-450e-9775-95b539635c00 tempest-TaggedAttachmentsTest-137868570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:55:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-c5966125-5d0e-4c87-bbc4-24cbaa2ff9cc req-3e370298-a4a4-450e-9775-95b539635c00 tempest-TaggedAttachmentsTest-137868570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49e2c35d-36fd-4c75-951f-644baf386004', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 10:55:53 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-c5966125-5d0e-4c87-bbc4-24cbaa2ff9cc req-3e370298-a4a4-450e-9775-95b539635c00 tempest-TaggedAttachmentsTest-137868570 None] attachment_update completed successfully. Sep 03 10:55:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-7d18323b-3e44-450f-9aa2-7717d42be816 req-d4dd82f6-2801-453e-a205-dd9e3bbf997c tempest-TaggedAttachmentsTest-137868570 None] Terminate volume connection completed successfully. Sep 03 10:55:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-7d18323b-3e44-450f-9aa2-7717d42be816 req-d4dd82f6-2801-453e-a205-dd9e3bbf997c tempest-TaggedAttachmentsTest-137868570 None] Deleting attachment 49e2c35d-36fd-4c75-951f-644baf386004. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:56:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-61d19df8-0843-4854-9496-8e2ddc0b4c11 req-b0dfe9f7-06e6-4a7d-a133-0c9ece77780e tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:56:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-61d19df8-0843-4854-9496-8e2ddc0b4c11 req-b0dfe9f7-06e6-4a7d-a133-0c9ece77780e tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:56:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-61d19df8-0843-4854-9496-8e2ddc0b4c11 req-b0dfe9f7-06e6-4a7d-a133-0c9ece77780e tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:56:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-61d19df8-0843-4854-9496-8e2ddc0b4c11 req-b0dfe9f7-06e6-4a7d-a133-0c9ece77780e tempest-ServerActionsTestOtherA-1983634105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e43f0e6-285c-42e6-b84f-3b26b27bb125', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 10:56:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-61d19df8-0843-4854-9496-8e2ddc0b4c11 req-b0dfe9f7-06e6-4a7d-a133-0c9ece77780e tempest-ServerActionsTestOtherA-1983634105 None] attachment_update completed successfully. Sep 03 10:56:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Acquiring lock "cinder-f0006db0-84ee-4fe6-b7f8-bb075a097c34-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:56:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Lock "cinder-f0006db0-84ee-4fe6-b7f8-bb075a097c34-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:56:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Acquiring lock "cinder-quobyte-f0006db0-84ee-4fe6-b7f8-bb075a097c34" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:56:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Lock "cinder-quobyte-f0006db0-84ee-4fe6-b7f8-bb075a097c34" acquired by "delete_volume" :: waited 0.050s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:56:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5b0b7f-d7ac-4ab3-94eb-e290b8946d34]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:56:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:56:13 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 Sep 03 10:56:13 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:56:13 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Sep 03 10:56:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34" returned: 0 in 0.857s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:56:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:56:13 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34 Sep 03 10:56:13 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:56:14 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f0006db0-84ee-4fe6-b7f8-bb075a097c34" returned: 0 in 0.470s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Lock "cinder-quobyte-f0006db0-84ee-4fe6-b7f8-bb075a097c34" released by "delete_volume" :: held 1.441s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Created reservations ['20af6fde-b32a-4fe1-9fa6-dc893ab85c70', '122ea673-a0d1-4230-b11f-0bc17bcbec8e', '8de7223c-6c2c-4d16-94b0-bf31196d16ac', '8b2f69fb-09bf-4215-afbf-350fb6730eac'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:56:14 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:56:14 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:56:14 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.508s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:56:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Deleted volume successfully. Sep 03 10:56:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19c71fdf-d408-4404-a999-b1e5474c058f tempest-TaggedAttachmentsTest-137868570 None] Lock "cinder-f0006db0-84ee-4fe6-b7f8-bb075a097c34-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:56:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-d7644aff-5c1b-4711-8655-270f03c22ddf req-f0f31f6d-8c75-4552-baba-c5fc083b9030 tempest-ServerActionsTestOtherA-1983634105 None] Terminate volume connection completed successfully. Sep 03 10:56:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-d7644aff-5c1b-4711-8655-270f03c22ddf req-f0f31f6d-8c75-4552-baba-c5fc083b9030 tempest-ServerActionsTestOtherA-1983634105 None] Deleting attachment 2e43f0e6-285c-42e6-b84f-3b26b27bb125. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:56:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-d7644aff-5c1b-4711-8655-270f03c22ddf req-6c05d603-835c-4881-acef-c969bafc4e3c tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:56:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-d7644aff-5c1b-4711-8655-270f03c22ddf req-6c05d603-835c-4881-acef-c969bafc4e3c tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:56:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-d7644aff-5c1b-4711-8655-270f03c22ddf req-6c05d603-835c-4881-acef-c969bafc4e3c tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:56:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-d7644aff-5c1b-4711-8655-270f03c22ddf req-6c05d603-835c-4881-acef-c969bafc4e3c tempest-ServerActionsTestOtherA-1983634105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f469b35f-e4d6-4638-b2a6-3ef6e58bd802', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 10:56:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-d7644aff-5c1b-4711-8655-270f03c22ddf req-6c05d603-835c-4881-acef-c969bafc4e3c tempest-ServerActionsTestOtherA-1983634105 None] attachment_update completed successfully. Sep 03 10:56:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:56:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:56:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:56:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:56:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:56:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:56:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:56:23 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:56:23 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:56:23 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Sep 03 10:56:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.502s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:56:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:56:26 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=27,cinder:SELECT=41,cinder:INSERT=3 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:56:26 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=42,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:56:38 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Flow 'volume_create_manager' (617d2b2d-d1f2-489f-afca-1e8e30b02c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46a4a83-1be7-406b-a630-f6af78f4be74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46a4a83-1be7-406b-a630-f6af78f4be74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-238151829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4066126-f454-4917-b96e-7f35918f47f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a865c1d45069452e96a99c7ea34fb1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:56:39Z,use_quota=True,user_id='dd710d3bf4864e0c8cdaaf11024ee561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cf4378-c8ba-48c5-b547-4052846f2921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cf4378-c8ba-48c5-b547-4052846f2921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1a6492-2b74-49bf-b95a-10e27762693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1a6492-2b74-49bf-b95a-10e27762693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4066126-f454-4917-b96e-7f35918f47f0', 'volume_name': 'volume-d4066126-f454-4917-b96e-7f35918f47f0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2465b40f-e701-4e41-a4d9-84fa4fbdda67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2465b40f-e701-4e41-a4d9-84fa4fbdda67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96989d8b-7fa5-4a40-a49d-88a7e14e1816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:56:39 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Volume d4066126-f454-4917-b96e-7f35918f47f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4066126-f454-4917-b96e-7f35918f47f0', 'volume_size': 1} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-238151829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4066126-f454-4917-b96e-7f35918f47f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a865c1d45069452e96a99c7ea34fb1f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:56:39Z,use_quota=True,user_id='dd710d3bf4864e0c8cdaaf11024ee561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Creating volume d4066126-f454-4917-b96e-7f35918f47f0 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:56:39 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:56:39 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0 1073741824 Sep 03 10:56:39 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:56:39 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0 1073741824" returned: 0 in 0.563s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:56:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:56:39 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0 Sep 03 10:56:39 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:56:39 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Sep 03 10:56:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0" returned: 0 in 0.299s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:56:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:56:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:56:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96989d8b-7fa5-4a40-a49d-88a7e14e1816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4066126-f454-4917-b96e-7f35918f47f0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:56:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ac6756-6a38-4e17-89b5-fca07966254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:56:40 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Volume volume-d4066126-f454-4917-b96e-7f35918f47f0 (d4066126-f454-4917-b96e-7f35918f47f0): created successfully Sep 03 10:56:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ac6756-6a38-4e17-89b5-fca07966254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:56:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Flow 'volume_create_manager' (617d2b2d-d1f2-489f-afca-1e8e30b02c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:56:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-290b4c68-7abd-4d76-9542-6087ac345f4e tempest-AttachVolumeShelveTestJSON-679173406 None] Created volume successfully. Sep 03 10:56:50 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:56:50 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:56:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-5aa1c119-c0a5-4075-b6dd-3bccb5f12cc6 req-7127b198-1a80-48d1-88d4-1b87a88a32bb tempest-AttachVolumeShelveTestJSON-679173406 None] No connector for attachment d995f386-3fae-4aa3-8411-f600d6e35f20; skipping storage backend terminate_connection call. {{(pid=86603) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 03 10:56:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-5aa1c119-c0a5-4075-b6dd-3bccb5f12cc6 req-7127b198-1a80-48d1-88d4-1b87a88a32bb tempest-AttachVolumeShelveTestJSON-679173406 None] Deleting attachment d995f386-3fae-4aa3-8411-f600d6e35f20. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Flow 'volume_create_manager' (67d6e179-6436-4cf4-b9aa-ca6db6e16ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1267a8-1db0-464c-9915-2bdcaebd9c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1267a8-1db0-464c-9915-2bdcaebd9c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-160310860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93ceb2f-c4bb-40ae-9fa4-96b1177ea311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad832d6130f4f62ac0fc381b7132787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:57:01Z,use_quota=True,user_id='bcc5bc2c980042cf91e01a9e9cca664f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632dc2c7-57ee-4200-8b11-f9cfbc5fe45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632dc2c7-57ee-4200-8b11-f9cfbc5fe45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8f130e-a56c-4d99-abc3-3e3216732b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8f130e-a56c-4d99-abc3-3e3216732b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93ceb2f-c4bb-40ae-9fa4-96b1177ea311', 'volume_name': 'volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa1b37e-5c33-46da-99ce-02de0601f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa1b37e-5c33-46da-99ce-02de0601f057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d10384f-e78f-479e-bf99-6f1ef0b9a9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Volume f93ceb2f-c4bb-40ae-9fa4-96b1177ea311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311', 'volume_size': 1} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-160310860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93ceb2f-c4bb-40ae-9fa4-96b1177ea311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad832d6130f4f62ac0fc381b7132787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:57:01Z,use_quota=True,user_id='bcc5bc2c980042cf91e01a9e9cca664f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Creating volume f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:57:01 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:57:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:01 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 1073741824 Sep 03 10:57:01 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:02 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 1073741824" returned: 0 in 0.871s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:02 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 Sep 03 10:57:02 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:03 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311" returned: 0 in 0.492s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:57:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d10384f-e78f-479e-bf99-6f1ef0b9a9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45fa219-0d40-4dbf-8864-32b9db4ade7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:03 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Volume volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 (f93ceb2f-c4bb-40ae-9fa4-96b1177ea311): created successfully Sep 03 10:57:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45fa219-0d40-4dbf-8864-32b9db4ade7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Flow 'volume_create_manager' (67d6e179-6436-4cf4-b9aa-ca6db6e16ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:57:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ceb5598c-692b-43cf-ba85-5b311a1a7630 tempest-AttachVolumeTestJSON-919719381 None] Created volume successfully. Sep 03 10:57:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-9660b1ae-63aa-41e1-87b2-ddd8dc4148fb req-675bb8b2-163d-4db8-9faa-4c889eef27cd tempest-ServerActionsTestOtherA-1983634105 None] Terminate volume connection completed successfully. Sep 03 10:57:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-9660b1ae-63aa-41e1-87b2-ddd8dc4148fb req-675bb8b2-163d-4db8-9faa-4c889eef27cd tempest-ServerActionsTestOtherA-1983634105 None] Deleting attachment f469b35f-e4d6-4638-b2a6-3ef6e58bd802. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:57:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e2cb07ea-da3a-4652-b4e0-225be1451946 req-417ac946-ec12-45f3-a431-8189f33145b7 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e2cb07ea-da3a-4652-b4e0-225be1451946 req-417ac946-ec12-45f3-a431-8189f33145b7 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e2cb07ea-da3a-4652-b4e0-225be1451946 req-417ac946-ec12-45f3-a431-8189f33145b7 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-e2cb07ea-da3a-4652-b4e0-225be1451946 req-417ac946-ec12-45f3-a431-8189f33145b7 tempest-AttachVolumeTestJSON-919719381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5787b5c6-47eb-472f-8cc7-330351b8dca0', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 10:57:06 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-e2cb07ea-da3a-4652-b4e0-225be1451946 req-417ac946-ec12-45f3-a431-8189f33145b7 tempest-AttachVolumeTestJSON-919719381 None] attachment_update completed successfully. Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Flow 'volume_create_manager' (0a8ad365-1011-4708-bf8f-9f3dfff821cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f16446f-cc26-44cf-95d4-5a28d03abc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f16446f-cc26-44cf-95d4-5a28d03abc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-470688057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a830975-ace8-4150-bcb0-7c2f4fa542e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0250dc004fcb44f5bac68725c2350d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:57:14Z,use_quota=True,user_id='b4044eb5a7dc4f95b81b2a4c8783e87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed4d939-ab90-4dac-997f-80cd3064a8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed4d939-ab90-4dac-997f-80cd3064a8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a6fb13-f3a2-473f-9c17-ea5209788c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a6fb13-f3a2-473f-9c17-ea5209788c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a830975-ace8-4150-bcb0-7c2f4fa542e8', 'volume_name': 'volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f1dead-442f-4c70-b810-74a7a1698c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f1dead-442f-4c70-b810-74a7a1698c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191898ac-8979-48e6-8185-46373636ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:14 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Volume 5a830975-ace8-4150-bcb0-7c2f4fa542e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8', 'volume_size': 1} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-470688057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a830975-ace8-4150-bcb0-7c2f4fa542e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0250dc004fcb44f5bac68725c2350d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:57:14Z,use_quota=True,user_id='b4044eb5a7dc4f95b81b2a4c8783e87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Creating volume 5a830975-ace8-4150-bcb0-7c2f4fa542e8 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:57:14 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:57:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:14 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 1073741824 Sep 03 10:57:14 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:15 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 1073741824" returned: 0 in 0.906s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:15 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 Sep 03 10:57:15 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:16 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8" returned: 0 in 0.571s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:57:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191898ac-8979-48e6-8185-46373636ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e06dc4c-4407-4644-8c9f-1e78b4885a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:16 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Volume volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 (5a830975-ace8-4150-bcb0-7c2f4fa542e8): created successfully Sep 03 10:57:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e06dc4c-4407-4644-8c9f-1e78b4885a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Flow 'volume_create_manager' (0a8ad365-1011-4708-bf8f-9f3dfff821cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:57:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a356dd41-e8cf-40d1-8949-737a25d24299 tempest-ServerRescueNegativeTestJSON-1474285039 None] Created volume successfully. Sep 03 10:57:21 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:57:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Flow 'volume_create_manager' (abd7848d-926b-43fb-a23c-c46fa7428c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:57:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e47fd7-fd79-4954-8354-a26971b3f24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e47fd7-fd79-4954-8354-a26971b3f24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1251593674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5495bcce-cc43-4b5c-8a1d-732ba1530ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a66318b76f4f41ac1c6dcdf8fe24f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:57:21Z,use_quota=True,user_id='37821390290849ea95aaab2d5262981f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7299528b-7433-4cb7-8c9f-882bed422094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7299528b-7433-4cb7-8c9f-882bed422094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73348653-7b50-43f0-b9fb-de0d2d737c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:21 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 10:57:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73348653-7b50-43f0-b9fb-de0d2d737c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5495bcce-cc43-4b5c-8a1d-732ba1530ed3', 'volume_name': 'volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef77ad43-caa3-4a98-9487-ae60fddaf0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef77ad43-caa3-4a98-9487-ae60fddaf0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c7748c-a816-4396-a254-638cb39d572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:22 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Volume 5495bcce-cc43-4b5c-8a1d-732ba1530ed3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 10:57:22 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Trying to clone 5495bcce-cc43-4b5c-8a1d-732ba1530ed3 from image f9d13994-8b06-4b71-9618-b02e2701e179 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 10:57:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:57:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:57:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:57:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:23 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:57:23 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:24 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.767s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:24 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:57:24 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:57:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 28 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 10:57:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 10:57:24 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD, size 20.69 MB, duration 1.49 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 10:57:24 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Image download 20.69 MB at 13.88 MB/s Sep 03 10:57:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f0c6a7-217c-4062-870b-d7bb6d4eb718]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:57:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:24 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD Sep 03 10:57:24 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:25 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:25 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 is fetched for user 37821390290849ea95aaab2d5262981f. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 10:57:25 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[133506a6-b33e-493d-a2ab-8359bbde01f3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:57:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:25 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD Sep 03 10:57:25 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:26 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1251593674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5495bcce-cc43-4b5c-8a1d-732ba1530ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a66318b76f4f41ac1c6dcdf8fe24f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:57:21Z,use_quota=True,user_id='37821390290849ea95aaab2d5262981f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Creating volume 5495bcce-cc43-4b5c-8a1d-732ba1530ed3 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:57:26 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:26 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 1073741824 Sep 03 10:57:26 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:26 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 1073741824" returned: 0 in 0.642s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:26 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 Sep 03 10:57:26 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:27 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3" returned: 0 in 0.381s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:57:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:27 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Attempting download of f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume 5495bcce-cc43-4b5c-8a1d-732ba1530ed3. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 10:57:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d9cd8b-0a67-4289-90a7-0c3cb733a371]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:57:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_uz2wsvm2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:27 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_uz2wsvm2 Sep 03 10:57:27 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:27 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_uz2wsvm2" returned: 0 in 0.367s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_uz2wsvm2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:27 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_uz2wsvm2 Sep 03 10:57:27 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:28 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_uz2wsvm2" returned: 1 in 0.410s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_uz2wsvm2' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 10:57:28 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb244a-6ee2-448c-818d-507673f54c73]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:57:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:28 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD Sep 03 10:57:28 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:28 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:28 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] f9d13994-8b06-4b71-9618-b02e2701e179 was qcow2, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 10:57:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:28 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 Sep 03 10:57:28 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:31 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3" returned: 0 in 2.512s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:31 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_xujkfdcydevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 10:57:31 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Converted 112.00 MB image at 44.57 MB/s Sep 03 10:57:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:31 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 1G Sep 03 10:57:31 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:32 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 1G" returned: 0 in 0.670s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Downloaded image f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume 5495bcce-cc43-4b5c-8a1d-732ba1530ed3 successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 for user 37821390290849ea95aaab2d5262981f is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Marking volume 5495bcce-cc43-4b5c-8a1d-732ba1530ed3 as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Copying metadata from image f9d13994-8b06-4b71-9618-b02e2701e179 to 5495bcce-cc43-4b5c-8a1d-732ba1530ed3. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Creating volume glance metadata for volume 5495bcce-cc43-4b5c-8a1d-732ba1530ed3 backed by image f9d13994-8b06-4b71-9618-b02e2701e179 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c7748c-a816-4396-a254-638cb39d572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae59a19d-a130-49c1-bb80-971b438894c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:57:32 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Volume volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 (5495bcce-cc43-4b5c-8a1d-732ba1530ed3): created successfully Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae59a19d-a130-49c1-bb80-971b438894c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:57:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Flow 'volume_create_manager' (abd7848d-926b-43fb-a23c-c46fa7428c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:57:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5826ccdf-ac79-4cce-8e3f-c7cb7a6896bc tempest-ServerActionsTestOtherA-1983634105 None] Created volume successfully. Sep 03 10:57:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Acquiring lock "cinder-5a830975-ace8-4150-bcb0-7c2f4fa542e8-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:57:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "cinder-5a830975-ace8-4150-bcb0-7c2f4fa542e8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:57:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Acquiring lock "cinder-quobyte-5a830975-ace8-4150-bcb0-7c2f4fa542e8" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:57:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "cinder-quobyte-5a830975-ace8-4150-bcb0-7c2f4fa542e8" acquired by "delete_volume" :: waited 0.069s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:57:33 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc00305-0b95-4240-9e95-8b17153f0e18]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:57:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:34 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 Sep 03 10:57:34 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:34 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8" returned: 0 in 0.781s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:34 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8 Sep 03 10:57:34 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:35 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5a830975-ace8-4150-bcb0-7c2f4fa542e8" returned: 0 in 0.629s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "cinder-quobyte-5a830975-ace8-4150-bcb0-7c2f4fa542e8" released by "delete_volume" :: held 1.514s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:57:35 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Created reservations ['62f08730-c046-4153-a8c2-3dbbe18b7c0c', '48a5825a-9422-4bdc-a828-3290b9eee5b0', 'b7ffb646-bba6-4bd0-a133-f34c7c5a69a7', '18b50001-b067-431b-ba39-2d017c5bb9f1'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:57:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:57:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:57:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:57:35 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:57:35 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:57:36 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Sep 03 10:57:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.510s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:57:36 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:57:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Deleted volume successfully. Sep 03 10:57:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9504faf5-68ba-4b1a-8bdb-7a3f4d3ec5d8 tempest-ServerRescueNegativeTestJSON-1474285039 None] Lock "cinder-5a830975-ace8-4150-bcb0-7c2f4fa542e8-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:57:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-84ec943e-7a7c-4ed8-9fa2-a6a5d4f054ae req-4656c2e0-c4fb-4407-a9f1-3b1b75cd2b90 tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-84ec943e-7a7c-4ed8-9fa2-a6a5d4f054ae req-4656c2e0-c4fb-4407-a9f1-3b1b75cd2b90 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-84ec943e-7a7c-4ed8-9fa2-a6a5d4f054ae req-4656c2e0-c4fb-4407-a9f1-3b1b75cd2b90 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-84ec943e-7a7c-4ed8-9fa2-a6a5d4f054ae req-4656c2e0-c4fb-4407-a9f1-3b1b75cd2b90 tempest-ServerActionsTestOtherA-1983634105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2525d239-0bc4-49f2-805c-cab2393d8189', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 10:57:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-84ec943e-7a7c-4ed8-9fa2-a6a5d4f054ae req-4656c2e0-c4fb-4407-a9f1-3b1b75cd2b90 tempest-ServerActionsTestOtherA-1983634105 None] attachment_update completed successfully. Sep 03 10:57:50 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=36,cinder:UPDATE=18,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:57:50 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=32,cinder:UPDATE=26,cinder:INSERT=9 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:57:54 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-69b03da5-e4cc-4094-99d4-b2cf288625bc req-a61b900c-ecab-490f-8e44-e4a128ca1a72 tempest-ServerActionsTestOtherA-1983634105 None] Terminate volume connection completed successfully. Sep 03 10:57:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-69b03da5-e4cc-4094-99d4-b2cf288625bc req-a61b900c-ecab-490f-8e44-e4a128ca1a72 tempest-ServerActionsTestOtherA-1983634105 None] Deleting attachment 2525d239-0bc4-49f2-805c-cab2393d8189. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:57:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-69b03da5-e4cc-4094-99d4-b2cf288625bc req-20497a54-2161-41fa-9349-1985f6788a5d tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:57:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-69b03da5-e4cc-4094-99d4-b2cf288625bc req-20497a54-2161-41fa-9349-1985f6788a5d tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:57:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-69b03da5-e4cc-4094-99d4-b2cf288625bc req-20497a54-2161-41fa-9349-1985f6788a5d tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:57:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-69b03da5-e4cc-4094-99d4-b2cf288625bc req-20497a54-2161-41fa-9349-1985f6788a5d tempest-ServerActionsTestOtherA-1983634105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e84acacc-d229-486c-8b19-364315419596', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 10:57:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-69b03da5-e4cc-4094-99d4-b2cf288625bc req-20497a54-2161-41fa-9349-1985f6788a5d tempest-ServerActionsTestOtherA-1983634105 None] attachment_update completed successfully. Sep 03 10:58:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-b4773e17-6e5b-4495-90bb-fbe7f48b3ced req-dbc817f7-46c1-4e0c-93f5-bf5c45ae7415 tempest-AttachVolumeTestJSON-919719381 None] Terminate volume connection completed successfully. Sep 03 10:58:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-b4773e17-6e5b-4495-90bb-fbe7f48b3ced req-dbc817f7-46c1-4e0c-93f5-bf5c45ae7415 tempest-AttachVolumeTestJSON-919719381 None] Deleting attachment 5787b5c6-47eb-472f-8cc7-330351b8dca0. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:58:06 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:58:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Acquiring lock "cinder-d4066126-f454-4917-b96e-7f35918f47f0-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "cinder-d4066126-f454-4917-b96e-7f35918f47f0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Acquiring lock "cinder-quobyte-d4066126-f454-4917-b96e-7f35918f47f0" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "cinder-quobyte-d4066126-f454-4917-b96e-7f35918f47f0" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:11 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c983dac-b992-484c-b2a3-aa8c408172db]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:58:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:11 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0 Sep 03 10:58:11 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:12 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0" returned: 0 in 0.854s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:12 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0 Sep 03 10:58:12 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:12 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d4066126-f454-4917-b96e-7f35918f47f0" returned: 0 in 0.631s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "cinder-quobyte-d4066126-f454-4917-b96e-7f35918f47f0" released by "delete_volume" :: held 1.594s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:13 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Created reservations ['c376d731-3eb3-4a52-a69d-0d6998773630', 'b52ac92a-b2df-4e4d-a2d3-4f9b99f8266e', 'a66327bb-15c3-4bd6-a3c6-26a94aecb506', 'f540e189-8d82-44ca-9bbf-c94ce6ea71c1'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:58:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:13 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:58:13 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:14 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.923s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:14 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:58:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Deleted volume successfully. Sep 03 10:58:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-74e07dee-f125-486e-8b4a-fddf6c06ff76 tempest-AttachVolumeShelveTestJSON-679173406 None] Lock "cinder-d4066126-f454-4917-b96e-7f35918f47f0-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:23 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:58:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:58:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:23 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:58:23 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:24 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.564s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:24 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:58:24 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:58:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 28 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 10:58:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 10:58:24 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=18,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:58:35 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-32a5005f-8617-4912-9750-356b7a4c38f6 tempest-ServerActionsTestOtherA-1983634105 None] Terminate volume connection completed successfully. Sep 03 10:58:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-32a5005f-8617-4912-9750-356b7a4c38f6 tempest-ServerActionsTestOtherA-1983634105 None] Deleting attachment e84acacc-d229-486c-8b19-364315419596. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:58:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "cinder-5495bcce-cc43-4b5c-8a1d-732ba1530ed3-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Lock "cinder-5495bcce-cc43-4b5c-8a1d-732ba1530ed3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "cinder-quobyte-5495bcce-cc43-4b5c-8a1d-732ba1530ed3" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Lock "cinder-quobyte-5495bcce-cc43-4b5c-8a1d-732ba1530ed3" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:36 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d698a72-b0be-4474-823c-a2f9d52591bb]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:58:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:36 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 Sep 03 10:58:36 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:36 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-32efd55d-4b63-4ee0-9668-4a922b0ca635 tempest-GroupSnapshotsTest-2057996011 None] Group tempest-GroupSnapshotsTest-Group-489227726: creating Sep 03 10:58:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3" returned: 0 in 0.842s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:37 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3 Sep 03 10:58:37 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-32efd55d-4b63-4ee0-9668-4a922b0ca635 tempest-GroupSnapshotsTest-2057996011 None] Group tempest-GroupSnapshotsTest-Group-489227726: created successfully Sep 03 10:58:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-32efd55d-4b63-4ee0-9668-4a922b0ca635 tempest-GroupSnapshotsTest-2057996011 None] Create group completed successfully. Sep 03 10:58:37 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5495bcce-cc43-4b5c-8a1d-732ba1530ed3" returned: 0 in 0.536s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Lock "cinder-quobyte-5495bcce-cc43-4b5c-8a1d-732ba1530ed3" released by "delete_volume" :: held 1.460s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:37 devstack cinder-volume[86603]: DEBUG cinder.quota [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Created reservations ['0f9f05a8-edb0-4000-b6be-ebbd3c2480f4', '3d4354ec-ac70-43e2-b59c-9023cc9c1018', '2b8d8d22-1b99-4095-a679-986dfdf495e9', '6413de7c-8b0e-4f23-8421-189485b0a85a'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:58:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:37 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:58:37 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "cinder-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Lock "cinder-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "cinder-quobyte-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:38 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.484s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.manager [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Lock "cinder-quobyte-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:38 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Deleted volume successfully. Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-5d522a13-3ee5-45d9-a466-ad9e94f3832a req-b1dff8eb-4e5f-441f-8bc5-2b9ae5de2303 tempest-ServerActionsTestOtherA-1983634105 None] Lock "cinder-5495bcce-cc43-4b5c-8a1d-732ba1530ed3-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c4926-1d79-4eb4-95d1-6a3eb0f7aee0]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:38 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 Sep 03 10:58:38 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:38 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1" returned: 0 in 0.492s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:38 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1 Sep 03 10:58:38 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Flow 'volume_create_manager' (f86d0aa0-8500-4373-9777-74b2f3f5f162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6442c1-56b1-40b0-8d5a-75476208b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6442c1-56b1-40b0-8d5a-75476208b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915306011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e9e3a4e-2557-4e75-8c37-7b7ed9f8fd76,host='devstack@QuobyteHD#QuobyteHD',id=e6df6eb1-279c-4dba-b805-4a401c57a898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da051b8f372246609a9a70737a53df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:58:39Z,use_quota=True,user_id='2a16b6f2951e441fa42de06ef30ba258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e9041b0-6e7c-4b81-8557-60a1c11f846b),volume_type_id=2e9041b0-6e7c-4b81-8557-60a1c11f846b)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb2aecd-5e9e-4cd1-8058-63cba3882e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb2aecd-5e9e-4cd1-8058-63cba3882e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37413379-5e02-4f41-931d-93491530b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37413379-5e02-4f41-931d-93491530b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6df6eb1-279c-4dba-b805-4a401c57a898', 'volume_name': 'volume-e6df6eb1-279c-4dba-b805-4a401c57a898', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51855292-49f1-403b-a30d-af137f075564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51855292-49f1-403b-a30d-af137f075564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1322b50-2d48-4399-8766-a4ef040223a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:39 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Volume e6df6eb1-279c-4dba-b805-4a401c57a898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6df6eb1-279c-4dba-b805-4a401c57a898', 'volume_size': 1} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e9e3a4e-2557-4e75-8c37-7b7ed9f8fd76,created_at=2026-09-03T08:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915306011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e9e3a4e-2557-4e75-8c37-7b7ed9f8fd76,host='devstack@QuobyteHD#QuobyteHD',id=e6df6eb1-279c-4dba-b805-4a401c57a898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da051b8f372246609a9a70737a53df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:58:39Z,use_quota=True,user_id='2a16b6f2951e441fa42de06ef30ba258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e9041b0-6e7c-4b81-8557-60a1c11f846b),volume_type_id=2e9041b0-6e7c-4b81-8557-60a1c11f846b)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Creating volume e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:58:39 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:39 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 1073741824 Sep 03 10:58:39 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:39 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1" returned: 0 in 0.422s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Lock "cinder-quobyte-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1" released by "delete_volume" :: held 0.992s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Created reservations ['104679ef-3d5b-4489-9e43-85dcd391a04d', '8e4b4a21-cb19-41e6-b0a8-b32342982e81', '3472a806-a45a-42c6-a09f-09801306870a', 'f992b7aa-cf76-492f-91f1-1689a4b15541'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:39 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:58:39 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:39 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 1073741824" returned: 0 in 0.673s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:39 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.449s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:58:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Deleted volume successfully. Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea34b7f1-610e-4ff9-ad05-d24511a7a539 tempest-ServerActionsTestOtherA-1983634105 None] Lock "cinder-3fb0a30f-230a-4dd1-9cc6-2f1057f6f8b1-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:39 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 Sep 03 10:58:39 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:40 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898" returned: 0 in 0.496s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:58:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1322b50-2d48-4399-8766-a4ef040223a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6df6eb1-279c-4dba-b805-4a401c57a898', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34a88d7-8d9b-46e0-bbb8-f5adef993b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:40 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Volume volume-e6df6eb1-279c-4dba-b805-4a401c57a898 (e6df6eb1-279c-4dba-b805-4a401c57a898): created successfully Sep 03 10:58:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34a88d7-8d9b-46e0-bbb8-f5adef993b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Flow 'volume_create_manager' (f86d0aa0-8500-4373-9777-74b2f3f5f162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:58:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-458735aa-b255-41ee-9f4e-b3b957675f95 tempest-GroupSnapshotsTest-2057996011 None] Created volume successfully. Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Flow 'volume_create_manager' (16994764-ca26-435b-af42-b45478d727a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4259ea-8c2e-4ee9-83c8-ac67ec1a9cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4259ea-8c2e-4ee9-83c8-ac67ec1a9cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1059420107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33d15f3-1d75-4ee6-92d6-1f7a82248b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de74ea79de54beab88fac831953a0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:58:41Z,use_quota=True,user_id='6c2e25110ea84ee3b9efe9c6a744ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efadbbd-05a1-43d0-9e4e-ee50bf1db73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efadbbd-05a1-43d0-9e4e-ee50bf1db73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b6ff42-52f1-4b00-b5aa-eca7acae74b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b6ff42-52f1-4b00-b5aa-eca7acae74b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33d15f3-1d75-4ee6-92d6-1f7a82248b80', 'volume_name': 'volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a67ede-5ede-4bcb-8958-eaa3592b94c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a67ede-5ede-4bcb-8958-eaa3592b94c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8bcfbf-126e-4fc8-9c3f-0345381f8107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:41 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Volume d33d15f3-1d75-4ee6-92d6-1f7a82248b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80', 'volume_size': 1} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1059420107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33d15f3-1d75-4ee6-92d6-1f7a82248b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de74ea79de54beab88fac831953a0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:58:41Z,use_quota=True,user_id='6c2e25110ea84ee3b9efe9c6a744ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Creating volume d33d15f3-1d75-4ee6-92d6-1f7a82248b80 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:58:41 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:58:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:41 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 1073741824 Sep 03 10:58:41 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] GroupSnapshot b0e0dec1-382b-43ac-8a03-9d251ebb4f2c: creating. Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Group snapshot b0e0dec1-382b-43ac-8a03-9d251ebb4f2c: creating. {{(pid=86603) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:42 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 1073741824" returned: 0 in 0.556s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:42 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 Sep 03 10:58:42 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:42 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80" returned: 0 in 0.451s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.732s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8bcfbf-126e-4fc8-9c3f-0345381f8107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152e595f-c80d-47c9-9e23-8e789faec353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Creating offline snapshot 99b1a566-da3d-41f9-9cd3-214390b28a3b of volume e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 10:58:42 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Volume volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 (d33d15f3-1d75-4ee6-92d6-1f7a82248b80): created successfully Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152e595f-c80d-47c9-9e23-8e789faec353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Flow 'volume_create_manager' (16994764-ca26-435b-af42-b45478d727a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c156a9c-47ad-4d5d-8f44-80fb3c759c29]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:58:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:42 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b2781ecd-3589-4978-a3f1-576d7c4fdfa1 tempest-ServersNegativeTestJSON-608314096 None] Created volume successfully. Sep 03 10:58:43 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 Sep 03 10:58:43 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:43 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898" returned: 0 in 0.734s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:43 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b 1G Sep 03 10:58:43 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:44 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b 1G" returned: 0 in 0.630s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6df6eb1-279c-4dba-b805-4a401c57a898 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:44 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6df6eb1-279c-4dba-b805-4a401c57a898 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b Sep 03 10:58:44 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:44 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6df6eb1-279c-4dba-b805-4a401c57a898 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b" returned: 0 in 0.501s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:44 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:58:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:44 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b Sep 03 10:58:44 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:45 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b" returned: 0 in 0.346s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:45 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.info Sep 03 10:58:45 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:45 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.info" returned: 0 in 0.384s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:45 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:58:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:45 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.info Sep 03 10:58:45 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:45 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.info" returned: 0 in 0.306s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.117s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:46 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-db6f518f-1a2f-454f-ae76-8453599fa867 tempest-GroupSnapshotsTest-2057996011 None] group_snapshot b0e0dec1-382b-43ac-8a03-9d251ebb4f2c: created successfully Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Flow 'volume_create_manager' (30ec0d01-8ffe-46be-8f9c-3faf9cf48d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b42b621-f86a-4976-bdc2-2cda825773f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b42b621-f86a-4976-bdc2-2cda825773f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1783854935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4838e8-b580-4349-8812-64217a389151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de74ea79de54beab88fac831953a0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:58:46Z,use_quota=True,user_id='6c2e25110ea84ee3b9efe9c6a744ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c25492-c407-41d7-a159-99a5432fc721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c25492-c407-41d7-a159-99a5432fc721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b5d215-e420-4450-bf16-d6fec75059a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b5d215-e420-4450-bf16-d6fec75059a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4838e8-b580-4349-8812-64217a389151', 'volume_name': 'volume-2c4838e8-b580-4349-8812-64217a389151', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf92380-f79f-4b83-819e-6d2ffbdce2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf92380-f79f-4b83-819e-6d2ffbdce2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dd0697-6022-4f4a-a506-2aae7db883a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:46 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Volume 2c4838e8-b580-4349-8812-64217a389151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4838e8-b580-4349-8812-64217a389151', 'volume_size': 1} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1783854935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4838e8-b580-4349-8812-64217a389151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de74ea79de54beab88fac831953a0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:58:46Z,use_quota=True,user_id='6c2e25110ea84ee3b9efe9c6a744ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Creating volume 2c4838e8-b580-4349-8812-64217a389151 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:58:46 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:46 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151 1073741824 Sep 03 10:58:46 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:46 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151 1073741824" returned: 0 in 0.614s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:46 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151 Sep 03 10:58:46 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:47 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151" returned: 0 in 0.395s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.028s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-99b1a566-da3d-41f9-9cd3-214390b28a3b-1ebc055a-5175-471e-b170-21e82ddb1096" by "_create_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dd0697-6022-4f4a-a506-2aae7db883a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4838e8-b580-4349-8812-64217a389151', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e14a35-6136-4bcb-85ee-e8ffe9e80b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-99b1a566-da3d-41f9-9cd3-214390b28a3b-1ebc055a-5175-471e-b170-21e82ddb1096" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Creating volume 1ebc055a-5175-471e-b170-21e82ddb1096 from snapshot 99b1a566-da3d-41f9-9cd3-214390b28a3b {{(pid=86603) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-1ebc055a-5175-471e-b170-21e82ddb1096" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:47 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Volume volume-2c4838e8-b580-4349-8812-64217a389151 (2c4838e8-b580-4349-8812-64217a389151): created successfully Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e14a35-6136-4bcb-85ee-e8ffe9e80b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Flow 'volume_create_manager' (30ec0d01-8ffe-46be-8f9c-3faf9cf48d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-1ebc055a-5175-471e-b170-21e82ddb1096" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] snapshot: 99b1a566-da3d-41f9-9cd3-214390b28a3b, volume: 1ebc055a-5175-471e-b170-21e82ddb1096, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-41ff37ed-ceed-46f1-b481-b3bf02bddccd tempest-ServersNegativeTestJSON-608314096 None] Created volume successfully. Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df4ecc4-b08d-4474-b3d9-cce5989ae63a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:47 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b Sep 03 10:58:47 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:47 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b" returned: 0 in 0.454s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df6eb1-279c-4dba-b805-4a401c57a898(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b215a721-7d74-48ec-885d-ce7b641f88e4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:58:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:48 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 Sep 03 10:58:48 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:48 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898" returned: 0 in 0.494s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 10:58:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 10:58:48 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 10:58:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:48 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 Sep 03 10:58:48 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "cinder-2c4838e8-b580-4349-8812-64217a389151-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Lock "cinder-2c4838e8-b580-4349-8812-64217a389151-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "cinder-quobyte-2c4838e8-b580-4349-8812-64217a389151" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Lock "cinder-quobyte-2c4838e8-b580-4349-8812-64217a389151" acquired by "delete_volume" :: waited 0.039s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa20c6ac-a298-4398-8ce7-b1420da4affd]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:58:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:49 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151 Sep 03 10:58:49 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:49 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151" returned: 0 in 0.855s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:49 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151 Sep 03 10:58:49 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:50 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c4838e8-b580-4349-8812-64217a389151" returned: 0 in 1.100s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Lock "cinder-quobyte-2c4838e8-b580-4349-8812-64217a389151" released by "delete_volume" :: held 2.046s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:51 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Created reservations ['59b501ea-b8e3-4fc1-9634-eb609062883e', 'f9f9e96e-5142-4a0b-93cb-5ffbd44e998a', 'b67ff6f6-b3de-41b3-a62f-8cc1abb68d06', '3d488480-a866-425d-bed3-90c5baf08dde'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:58:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:51 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:58:51 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:52 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.979s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:52 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:58:52 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Deleted volume successfully. Sep 03 10:58:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "cinder-d33d15f3-1d75-4ee6-92d6-1f7a82248b80-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-878681b2-8c24-4f2d-b26f-df999641c179 tempest-ServersNegativeTestJSON-608314096 None] Lock "cinder-2c4838e8-b580-4349-8812-64217a389151-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Lock "cinder-d33d15f3-1d75-4ee6-92d6-1f7a82248b80-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "cinder-quobyte-d33d15f3-1d75-4ee6-92d6-1f7a82248b80" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Lock "cinder-quobyte-d33d15f3-1d75-4ee6-92d6-1f7a82248b80" acquired by "delete_volume" :: waited 0.060s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:53 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c043d4e-69b5-4afa-b472-fddfb39bdf33]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:58:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:53 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 Sep 03 10:58:53 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:54 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80" returned: 0 in 1.154s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:54 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80 Sep 03 10:58:54 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:55 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d33d15f3-1d75-4ee6-92d6-1f7a82248b80" returned: 0 in 0.816s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Lock "cinder-quobyte-d33d15f3-1d75-4ee6-92d6-1f7a82248b80" released by "delete_volume" :: held 2.148s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Created reservations ['0a1cf4cd-dd4f-4776-8ada-7f4e5c262ae7', '93f08f7d-e476-46fd-ab00-bf8c95d6dc24', '15a2d060-46b3-4b4c-8cc5-401daf576cce', '8c41bb81-6a94-46ce-8d2a-9a8452323010'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:55 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:58:55 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:55 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096" returned: 0 in 7.385s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 10:58:55 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Converted 1024.00 MB image at 138.61 MB/s Sep 03 10:58:55 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:58:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:55 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 Sep 03 10:58:55 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:56 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.526s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:56 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:58:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Deleted volume successfully. Sep 03 10:58:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4ccc8756-50f7-4433-8194-3b60fcceab2f tempest-ServersNegativeTestJSON-608314096 None] Lock "cinder-d33d15f3-1d75-4ee6-92d6-1f7a82248b80-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:56 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096" returned: 0 in 0.356s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-1ebc055a-5175-471e-b170-21e82ddb1096" released by "_copy_volume_from_snapshot" :: held 8.820s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-99b1a566-da3d-41f9-9cd3-214390b28a3b-1ebc055a-5175-471e-b170-21e82ddb1096" released by "_create_volume_from_snapshot" :: held 8.933s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:58:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.983s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:58:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b877fcb4-4922-44c8-b874-b20503c196ec tempest-GroupSnapshotsTest-2057996011 None] Create group from source-snapshot-b0e0dec1-382b-43ac-8a03-9d251ebb4f2c completed successfully. Sep 03 10:58:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-1ebc055a-5175-471e-b170-21e82ddb1096" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:58:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-1ebc055a-5175-471e-b170-21e82ddb1096" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:58:58 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627797c-b4d6-42cc-b72f-6f5763827a76]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:58:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:58 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 Sep 03 10:58:58 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:59 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096" returned: 0 in 0.899s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:58:59 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096 Sep 03 10:58:59 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:58:59 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 03 10:58:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1ebc055a-5175-471e-b170-21e82ddb1096" returned: 0 in 0.541s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:58:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-1ebc055a-5175-471e-b170-21e82ddb1096" released by "delete_volume" :: held 1.561s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['e65410e5-4254-4df9-8151-417a2dc3cc2e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:00 devstack cinder-volume[86603]: WARNING cinder.quota [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1044794910 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1044794910, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:00 devstack cinder-volume[86603]: WARNING cinder.quota [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1044794910 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1044794910, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['2f5e9e01-2d52-46c2-9527-a5c3d2e0c49c', 'fd369bb1-ce46-4d46-a8f1-2128b1444cd7', '481ebcc5-011a-4a39-9b93-0962c3857c57', '148548da-fcc0-434a-871a-1f24a768be09'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:00 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:00 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:00 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.397s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:00 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-733ba07c-9f6a-4567-bdd0-80b674a237f1 tempest-GroupSnapshotsTest-2057996011 None] Delete group completed successfully. Sep 03 10:59:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] group_snapshot b0e0dec1-382b-43ac-8a03-9d251ebb4f2c: deleting Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] group_snapshot b0e0dec1-382b-43ac-8a03-9d251ebb4f2c: deleting {{(pid=86603) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-e6df6eb1-279c-4dba-b805-4a401c57a898" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-e6df6eb1-279c-4dba-b805-4a401c57a898" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-99b1a566-da3d-41f9-9cd3-214390b28a3b" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Flow 'volume_create_manager' (f30e41f1-924e-4e12-8110-234044a72cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b52e3c-4cd4-4574-bf69-8eba64e26b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-99b1a566-da3d-41f9-9cd3-214390b28a3b" acquired by "_delete_snapshot" :: waited 0.078s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Deleting offline snapshot 99b1a566-da3d-41f9-9cd3-214390b28a3b of volume e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] snapshot_file for this snap is: volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cd859b-5fcd-4384-9906-bc44f3007e85]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b52e3c-4cd4-4574-bf69-8eba64e26b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-373237774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e76e7d91c704674a40b76ab5581bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:01Z,use_quota=True,user_id='05ddd3785a42459aabec8ceafe2268de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4928a003-3892-4c61-a5a4-c2568f50b929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4928a003-3892-4c61-a5a4-c2568f50b929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a310f15c-7737-427f-9792-2873ae769945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a310f15c-7737-427f-9792-2873ae769945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc', 'volume_name': 'volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f321433-91cf-4b7b-98f0-c26379d6f780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f321433-91cf-4b7b-98f0-c26379d6f780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0872252-35ff-48c8-9c24-7882129ba393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Volume 22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc', 'volume_size': 1} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-373237774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e76e7d91c704674a40b76ab5581bf19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:01Z,use_quota=True,user_id='05ddd3785a42459aabec8ceafe2268de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Creating volume 22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:01 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:01 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b Sep 03 10:59:01 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:01 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc 1073741824 Sep 03 10:59:01 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:02 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b" returned: 0 in 0.489s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df6eb1-279c-4dba-b805-4a401c57a898(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b18461b-5826-4852-a99d-caa8c4f290dd]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:02 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc 1073741824" returned: 0 in 0.540s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:02 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 Sep 03 10:59:02 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:02 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc Sep 03 10:59:02 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:02 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" returned: 0 in 0.532s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0872252-35ff-48c8-9c24-7882129ba393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523247db-283b-41ed-9481-f2b8d3ae3b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:02 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Volume volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc (22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc): created successfully Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523247db-283b-41ed-9481-f2b8d3ae3b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Flow 'volume_create_manager' (f30e41f1-924e-4e12-8110-234044a72cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-aa5e1077-e5a4-40b1-8514-d781029a5e1e req-fd8c4122-5bca-40a9-bcef-370df11ee754 tempest-VolumesSnapshotsTestJSON-1959270206 None] Created volume successfully. Sep 03 10:59:02 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898" returned: 0 in 0.910s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:03 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b Sep 03 10:59:03 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:03 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b" returned: 0 in 0.529s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:03 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b Sep 03 10:59:03 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:04 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898.99b1a566-da3d-41f9-9cd3-214390b28a3b" returned: 0 in 0.487s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-99b1a566-da3d-41f9-9cd3-214390b28a3b" released by "_delete_snapshot" :: held 2.615s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-e6df6eb1-279c-4dba-b805-4a401c57a898" released by "delete_snapshot" :: held 2.715s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Creating offline snapshot 35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 of volume 22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 10:59:04 devstack cinder-volume[86603]: WARNING cinder.quota [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1044794910 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1044794910, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b469c0-9469-4fe1-9772-07b8a06aa91a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['532495ce-4eef-40f6-8d30-1b4c6d84a7f5', '24509150-e971-4624-b553-408de8b96b2a', 'f9d691b8-039b-402c-a805-ebfe9b510fd1', 'a2fe0c11-ddd7-4008-a9b1-7fa4a889c727'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:04 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc Sep 03 10:59:04 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2588883e-bc5f-45b4-8702-35deab663e38 tempest-GroupSnapshotsTest-2057996011 None] group_snapshot b0e0dec1-382b-43ac-8a03-9d251ebb4f2c: deleted successfully Sep 03 10:59:04 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" returned: 0 in 0.627s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:05 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 1G Sep 03 10:59:05 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-e6df6eb1-279c-4dba-b805-4a401c57a898" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-e6df6eb1-279c-4dba-b805-4a401c57a898" acquired by "delete_volume" :: waited 0.045s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:05 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b04737-f257-4d20-a6ae-6f3705caedab]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:05 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 Sep 03 10:59:05 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:05 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 1G" returned: 0 in 0.803s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:05 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 Sep 03 10:59:05 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:05 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898" returned: 0 in 0.549s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:06 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898 Sep 03 10:59:06 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:06 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172" returned: 0 in 0.419s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:06 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 is being set with open permissions: ugo+rw Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:06 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 Sep 03 10:59:06 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:06 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e6df6eb1-279c-4dba-b805-4a401c57a898" returned: 0 in 0.331s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-e6df6eb1-279c-4dba-b805-4a401c57a898" released by "delete_volume" :: held 0.984s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['b15f6bda-c30d-4a22-b947-5586a6ba4039'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:06 devstack cinder-volume[86603]: WARNING cinder.db.api [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1044794910'] Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['51a12d59-c9e3-4c9f-9d6e-1636a328fd81', 'b8b7045f-2f2e-46a1-870c-8ceb8640ec4f', '43fc3aff-6210-455a-82cf-edef4a3235f0', 'f8e31cb9-f49c-40c4-a8e9-cd69f3095e6d'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:06 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172" returned: 0 in 0.310s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:06 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.info Sep 03 10:59:06 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:06 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:06 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:06 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.266s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:06 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-46ddd439-0d23-481b-a9ae-ee601009d23a tempest-GroupSnapshotsTest-2057996011 None] Delete group completed successfully. Sep 03 10:59:06 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.info" returned: 0 in 0.363s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:06 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.info is being set with open permissions: ugo+rw Sep 03 10:59:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:06 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.info Sep 03 10:59:06 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:07 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.info" returned: 0 in 0.238s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.950s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:07 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-e57c22d1-e6ec-404c-9ef4-e4f8607a7740 req-ddbfabb3-5461-4c91-9d29-01e9f8e786f9 tempest-VolumesSnapshotsTestJSON-1959270206 None] Create snapshot completed successfully Sep 03 10:59:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Acquiring lock "cinder-35eb3da5-4dc3-4c68-bd5c-18e6ce39c172-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-35eb3da5-4dc3-4c68-bd5c-18e6ce39c172-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Acquiring lock "cinder-quobyte-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-quobyte-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Acquiring lock "cinder-quobyte-35eb3da5-4dc3-4c68-bd5c-18e6ce39c172" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-quobyte-35eb3da5-4dc3-4c68-bd5c-18e6ce39c172" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Deleting offline snapshot 35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 of volume 22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] snapshot_file for this snap is: volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16d0b27-4131-4545-a1cc-1783124888e6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:08 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 Sep 03 10:59:08 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8f0a0d7e-ac80-44fb-9883-dbc3e8b7b1ad tempest-GroupSnapshotsTest-2057996011 None] Group tempest-GroupSnapshotsTest-Group-834310221: creating Sep 03 10:59:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8f0a0d7e-ac80-44fb-9883-dbc3e8b7b1ad tempest-GroupSnapshotsTest-2057996011 None] Group tempest-GroupSnapshotsTest-Group-834310221: created successfully Sep 03 10:59:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8f0a0d7e-ac80-44fb-9883-dbc3e8b7b1ad tempest-GroupSnapshotsTest-2057996011 None] Create group completed successfully. Sep 03 10:59:08 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172" returned: 0 in 0.461s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[dece5134-ddf6-4dfc-8cc2-a79bcabf383f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:08 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc Sep 03 10:59:08 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:09 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" returned: 0 in 0.403s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:09 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 Sep 03 10:59:09 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:09 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172" returned: 0 in 0.468s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:09 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172 Sep 03 10:59:09 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:09 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc.35eb3da5-4dc3-4c68-bd5c-18e6ce39c172" returned: 0 in 0.364s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-quobyte-35eb3da5-4dc3-4c68-bd5c-18e6ce39c172" released by "_delete_snapshot" :: held 1.918s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-quobyte-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" released by "delete_snapshot" :: held 1.979s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:10 devstack cinder-volume[86603]: WARNING cinder.quota [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.quota [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Created reservations ['1b644bfd-463f-424f-b700-0c0a73182ab7', '74b1a496-7467-4576-9c32-a156406244d0', '8dd461a2-17be-4163-a6c1-1d14f384847b', '5843bde1-aea3-448c-a1ea-cbfb15219226'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Delete snapshot completed successfully. Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-9a8615d8-d7c0-4cde-8d73-ebc45ec0d6e5 req-8326f878-08d3-4629-aa05-8861237488d2 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-35eb3da5-4dc3-4c68-bd5c-18e6ce39c172-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Acquiring lock "cinder-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Flow 'volume_create_manager' (6e8ea554-b309-48d2-aaec-6abefd387066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b95a6f6-6511-40cd-9977-d439d1b05acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b95a6f6-6511-40cd-9977-d439d1b05acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606343524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c064de53-bec7-4cad-b7a1-93145fc8da65,host='devstack@QuobyteHD#QuobyteHD',id=db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da051b8f372246609a9a70737a53df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:10Z,use_quota=True,user_id='2a16b6f2951e441fa42de06ef30ba258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7f9b554-a00e-4867-b0ed-af94ef0bcd43),volume_type_id=b7f9b554-a00e-4867-b0ed-af94ef0bcd43)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d698045-2464-4c1b-a278-21a05c504305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d698045-2464-4c1b-a278-21a05c504305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1b4d4b-d67e-4384-a822-1fbd1dae838e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1b4d4b-d67e-4384-a822-1fbd1dae838e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3', 'volume_name': 'volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd24331-ddce-47ed-905f-80ce76a06d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd24331-ddce-47ed-905f-80ce76a06d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c735cb-9490-4e87-aff6-5a3d32e6cd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:10 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Volume db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3', 'volume_size': 1} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c064de53-bec7-4cad-b7a1-93145fc8da65,created_at=2026-09-03T08:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1606343524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c064de53-bec7-4cad-b7a1-93145fc8da65,host='devstack@QuobyteHD#QuobyteHD',id=db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da051b8f372246609a9a70737a53df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:10Z,use_quota=True,user_id='2a16b6f2951e441fa42de06ef30ba258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7f9b554-a00e-4867-b0ed-af94ef0bcd43),volume_type_id=b7f9b554-a00e-4867-b0ed-af94ef0bcd43)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Creating volume db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:10 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Acquiring lock "cinder-quobyte-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-quobyte-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:10 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 1073741824 Sep 03 10:59:10 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef95947c-d08f-456b-910c-9589d600bd7f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:10 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc Sep 03 10:59:10 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:11 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" returned: 0 in 0.400s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:11 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc Sep 03 10:59:11 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:11 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 1073741824" returned: 0 in 0.567s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:11 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 Sep 03 10:59:11 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:11 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" returned: 0 in 0.315s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-quobyte-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc" released by "delete_volume" :: held 0.791s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG cinder.quota [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Created reservations ['d7dfe396-4102-45b3-9240-1b5e55301503', 'e0f4d065-8a11-4eda-8b21-014cc5029c9b', '462f3e87-d122-4f49-95c9-843a6deab426', '7e6ed81b-ff30-4f9f-91ee-e36db4b6de84'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:11 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" returned: 0 in 0.424s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c735cb-9490-4e87-aff6-5a3d32e6cd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8437a5ad-953d-4a01-9aa5-9d5881f7bda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:11 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Volume volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 (db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3): created successfully Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8437a5ad-953d-4a01-9aa5-9d5881f7bda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Flow 'volume_create_manager' (6e8ea554-b309-48d2-aaec-6abefd387066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-dde862ce-e19d-4171-b26f-b280c93a889a tempest-GroupSnapshotsTest-2057996011 None] Created volume successfully. Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:11 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:11 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:12 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.318s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:12 devstack cinder-volume[86603]: DEBUG cinder.manager [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:12 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Deleted volume successfully. Sep 03 10:59:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-759fdc82-be8c-4bbc-a812-37ca86363f5a req-af27c2a5-3639-4421-a056-3f4f2e3abb14 tempest-VolumesSnapshotsTestJSON-1959270206 None] Lock "cinder-22ecf02b-8ec2-4ce8-b8ea-9e8b1612fdbc-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Flow 'volume_create_manager' (1aa62975-3dd9-45a9-a217-5b95da9de9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd8e404-940e-4d57-9b3b-1202e4316454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd8e404-940e-4d57-9b3b-1202e4316454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1087549044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c064de53-bec7-4cad-b7a1-93145fc8da65,host='devstack@QuobyteHD#QuobyteHD',id=7965576f-8f04-4d39-8c8e-37855e1a250b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da051b8f372246609a9a70737a53df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:14Z,use_quota=True,user_id='2a16b6f2951e441fa42de06ef30ba258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7f9b554-a00e-4867-b0ed-af94ef0bcd43),volume_type_id=b7f9b554-a00e-4867-b0ed-af94ef0bcd43)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22c000e-90bd-4d64-8445-5a546a81d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22c000e-90bd-4d64-8445-5a546a81d259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a85ce9e-fead-4eb1-b7ae-416e0369ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a85ce9e-fead-4eb1-b7ae-416e0369ea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7965576f-8f04-4d39-8c8e-37855e1a250b', 'volume_name': 'volume-7965576f-8f04-4d39-8c8e-37855e1a250b', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6e3dce-db1f-4c2f-87cf-8c1d591ca092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6e3dce-db1f-4c2f-87cf-8c1d591ca092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60adf82c-6389-4f94-a4ac-4064350f1a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Volume 7965576f-8f04-4d39-8c8e-37855e1a250b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7965576f-8f04-4d39-8c8e-37855e1a250b', 'volume_size': 1} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c064de53-bec7-4cad-b7a1-93145fc8da65,created_at=2026-09-03T08:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1087549044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c064de53-bec7-4cad-b7a1-93145fc8da65,host='devstack@QuobyteHD#QuobyteHD',id=7965576f-8f04-4d39-8c8e-37855e1a250b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da051b8f372246609a9a70737a53df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:14Z,use_quota=True,user_id='2a16b6f2951e441fa42de06ef30ba258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7f9b554-a00e-4867-b0ed-af94ef0bcd43),volume_type_id=b7f9b554-a00e-4867-b0ed-af94ef0bcd43)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Creating volume 7965576f-8f04-4d39-8c8e-37855e1a250b {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:13 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:14 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b 1073741824 Sep 03 10:59:14 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:14 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b 1073741824" returned: 0 in 0.575s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:14 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b Sep 03 10:59:14 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:14 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b" returned: 0 in 0.277s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60adf82c-6389-4f94-a4ac-4064350f1a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7965576f-8f04-4d39-8c8e-37855e1a250b', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17985f46-b59e-4a90-a5ec-8bae9e843481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:14 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Volume volume-7965576f-8f04-4d39-8c8e-37855e1a250b (7965576f-8f04-4d39-8c8e-37855e1a250b): created successfully Sep 03 10:59:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17985f46-b59e-4a90-a5ec-8bae9e843481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Flow 'volume_create_manager' (1aa62975-3dd9-45a9-a217-5b95da9de9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4a370e14-172c-417d-b59d-9101b913b764 tempest-GroupSnapshotsTest-2057996011 None] Created volume successfully. Sep 03 10:59:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ae22dc49-b81d-4cc1-b0d4-27fbd7c9266a tempest-GroupSnapshotsTest-2057996011 None] Update group completed successfully. Sep 03 10:59:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-96628eca-a93c-4f2a-b6e5-3b20c0ea9f2c tempest-GroupSnapshotsTest-2057996011 None] Update group completed successfully. Sep 03 10:59:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b868114f-0487-4691-9dce-48289cfcc09f tempest-GroupSnapshotsV319Test-6485847 None] Group tempest-GroupSnapshotsV319Test-Group-1392543097: creating Sep 03 10:59:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b868114f-0487-4691-9dce-48289cfcc09f tempest-GroupSnapshotsV319Test-6485847 None] Group tempest-GroupSnapshotsV319Test-Group-1392543097: created successfully Sep 03 10:59:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b868114f-0487-4691-9dce-48289cfcc09f tempest-GroupSnapshotsV319Test-6485847 None] Create group completed successfully. Sep 03 10:59:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1167d24e-80d0-435f-bbc5-0ab4acb9d3e7 tempest-GroupSnapshotsTest-2057996011 None] Update group completed successfully. Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Flow 'volume_create_manager' (7ef6599d-9774-4c26-bb6d-efab2ce76c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6510f56e-1694-4aa9-998f-732c72843002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6510f56e-1694-4aa9-998f-732c72843002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806926735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93038fd5-603b-4f89-8deb-479bfb71af67,host='devstack@QuobyteHD#QuobyteHD',id=c524972a-e284-449a-8bc6-056f1d6a7236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b12137730e49588f5c5b38ef901266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:18Z,use_quota=True,user_id='54f405d168c9411586b39f08c5ed6c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(907e484c-d205-47c2-99b2-9193c4eacf9b),volume_type_id=907e484c-d205-47c2-99b2-9193c4eacf9b)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d08195-e966-43ee-a24b-ed77c6f74ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d08195-e966-43ee-a24b-ed77c6f74ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2eab22-65b2-4007-abb7-5d4f5e7d217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2eab22-65b2-4007-abb7-5d4f5e7d217e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c524972a-e284-449a-8bc6-056f1d6a7236', 'volume_name': 'volume-c524972a-e284-449a-8bc6-056f1d6a7236', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51808607-d3db-4987-9439-ee3bbd864775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51808607-d3db-4987-9439-ee3bbd864775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed40681-2621-48ca-8bbd-b4e5be44b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:18 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Volume c524972a-e284-449a-8bc6-056f1d6a7236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c524972a-e284-449a-8bc6-056f1d6a7236', 'volume_size': 1} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=93038fd5-603b-4f89-8deb-479bfb71af67,created_at=2026-09-03T08:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806926735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93038fd5-603b-4f89-8deb-479bfb71af67,host='devstack@QuobyteHD#QuobyteHD',id=c524972a-e284-449a-8bc6-056f1d6a7236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b12137730e49588f5c5b38ef901266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:18Z,use_quota=True,user_id='54f405d168c9411586b39f08c5ed6c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(907e484c-d205-47c2-99b2-9193c4eacf9b),volume_type_id=907e484c-d205-47c2-99b2-9193c4eacf9b)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Creating volume c524972a-e284-449a-8bc6-056f1d6a7236 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:18 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:18 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 1073741824 Sep 03 10:59:18 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2270ba64-69f5-481d-bdf1-b23fb99ff792 tempest-GroupSnapshotsTest-2057996011 None] Update group completed successfully. Sep 03 10:59:18 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 1073741824" returned: 0 in 0.549s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:19 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 Sep 03 10:59:19 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:19 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236" returned: 0 in 0.282s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed40681-2621-48ca-8bbd-b4e5be44b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c524972a-e284-449a-8bc6-056f1d6a7236', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89cc298-99f2-4b39-93a2-8e94dc578fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:19 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Volume volume-c524972a-e284-449a-8bc6-056f1d6a7236 (c524972a-e284-449a-8bc6-056f1d6a7236): created successfully Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89cc298-99f2-4b39-93a2-8e94dc578fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Flow 'volume_create_manager' (7ef6599d-9774-4c26-bb6d-efab2ce76c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:19 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-58a05fe1-1521-4162-97be-e47f235762e6 tempest-GroupSnapshotsV319Test-6485847 None] Created volume successfully. Sep 03 10:59:19 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] GroupSnapshot f53c8d2f-d403-4bf7-8159-0a73c6368a9f: creating. Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Group snapshot f53c8d2f-d403-4bf7-8159-0a73c6368a9f: creating. {{(pid=86603) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Creating offline snapshot 96631d6a-32b1-4938-a1ca-9c6b242f8138 of volume c524972a-e284-449a-8bc6-056f1d6a7236 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 10:59:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e3ab57-78c2-488c-9aab-e99d4d897bf1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:20 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 Sep 03 10:59:20 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:20 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] GroupSnapshot e3999e3c-4eec-412b-b683-04dc6f98a419: creating. Sep 03 10:59:20 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236" returned: 0 in 0.598s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:20 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 1G Sep 03 10:59:20 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Group snapshot e3999e3c-4eec-412b-b683-04dc6f98a419: creating. {{(pid=86603) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 10:59:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:21 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 1G" returned: 0 in 0.503s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c524972a-e284-449a-8bc6-056f1d6a7236 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:21 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c524972a-e284-449a-8bc6-056f1d6a7236 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 Sep 03 10:59:21 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:21 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c524972a-e284-449a-8bc6-056f1d6a7236 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138" returned: 0 in 0.357s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:21 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:59:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:21 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 Sep 03 10:59:21 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:21 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138" returned: 0 in 0.287s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:21 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.info Sep 03 10:59:21 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:22 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.info" returned: 0 in 0.273s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:22 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:22 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.info Sep 03 10:59:22 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:22 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.info" returned: 0 in 0.275s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.695s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Creating offline snapshot 55e7e919-4bea-4780-b942-c0942bd2a118 of volume db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbcf103-7ddc-4897-b2d8-6ce5854f5114]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:22 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-78a1dfed-ac32-4970-832b-bbf11cd56a5c tempest-GroupSnapshotsV319Test-6485847 None] group_snapshot f53c8d2f-d403-4bf7-8159-0a73c6368a9f: created successfully Sep 03 10:59:22 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 Sep 03 10:59:22 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:22 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" returned: 0 in 0.453s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:22 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 1G Sep 03 10:59:22 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:23 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 1G" returned: 0 in 0.547s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:23 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:23 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:23 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 Sep 03 10:59:23 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:23 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] group_snapshot f53c8d2f-d403-4bf7-8159-0a73c6368a9f: deleting Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] group_snapshot f53c8d2f-d403-4bf7-8159-0a73c6368a9f: deleting {{(pid=86603) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Acquiring lock "cinder-quobyte-c524972a-e284-449a-8bc6-056f1d6a7236" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:23 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.381s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Lock "cinder-quobyte-c524972a-e284-449a-8bc6-056f1d6a7236" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Acquiring lock "cinder-quobyte-96631d6a-32b1-4938-a1ca-9c6b242f8138" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 28 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Lock "cinder-quobyte-96631d6a-32b1-4938-a1ca-9c6b242f8138" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Deleting offline snapshot 96631d6a-32b1-4938-a1ca-9c6b242f8138 of volume c524972a-e284-449a-8bc6-056f1d6a7236 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] snapshot_file for this snap is: volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[071b52f5-0f1d-4837-a599-f1d38d46dc33]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:23 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118" returned: 0 in 0.455s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:23 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:59:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:23 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 Sep 03 10:59:23 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:24 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 Sep 03 10:59:24 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:24 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118" returned: 0 in 0.270s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:24 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.info Sep 03 10:59:24 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:24 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138" returned: 0 in 0.419s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c524972a-e284-449a-8bc6-056f1d6a7236(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c658db5-1ed9-4229-8380-dc6bb2361ed8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:24 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 Sep 03 10:59:24 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:24 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.info" returned: 0 in 0.347s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:24 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:24 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.info Sep 03 10:59:24 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:24 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236" returned: 0 in 0.499s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:24 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 Sep 03 10:59:24 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:24 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.info" returned: 0 in 0.341s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.560s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Creating offline snapshot b9f8c6b4-e9ae-4ba0-822a-c8774127b14a of volume 7965576f-8f04-4d39-8c8e-37855e1a250b {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5570dc90-caf5-47dc-b62c-d2088c1c77ee]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:25 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b Sep 03 10:59:25 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Flow 'volume_create_manager' (72eb4c33-7cc5-46da-8b77-df98d9ee54a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecfcf23-824b-4101-8aa2-5115a8eb135d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecfcf23-824b-4101-8aa2-5115a8eb135d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1082824815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276fea70-9d1b-4e0a-93c9-527ee6c6c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad832d6130f4f62ac0fc381b7132787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:25Z,use_quota=True,user_id='bcc5bc2c980042cf91e01a9e9cca664f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3788a3db-eeef-4cba-b617-88b70b009833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3788a3db-eeef-4cba-b617-88b70b009833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7a4326-b4a2-45f9-9814-a557a9b77d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7a4326-b4a2-45f9-9814-a557a9b77d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276fea70-9d1b-4e0a-93c9-527ee6c6c6f3', 'volume_name': 'volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c65d2d-f1df-4b6b-883d-6db890d0ad83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c65d2d-f1df-4b6b-883d-6db890d0ad83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99745cf9-1e73-41dc-a906-8f0542888629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:25 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Volume 276fea70-9d1b-4e0a-93c9-527ee6c6c6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3', 'volume_size': 1} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:25 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138" returned: 0 in 0.481s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:25 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138 Sep 03 10:59:25 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:25 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b" returned: 0 in 0.480s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:25 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a 1G Sep 03 10:59:25 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:25 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236.96631d6a-32b1-4938-a1ca-9c6b242f8138" returned: 0 in 0.304s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Lock "cinder-quobyte-96631d6a-32b1-4938-a1ca-9c6b242f8138" released by "_delete_snapshot" :: held 1.820s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Lock "cinder-quobyte-c524972a-e284-449a-8bc6-056f1d6a7236" released by "delete_snapshot" :: held 1.856s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:25 devstack cinder-volume[86603]: WARNING cinder.quota [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1013619334 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1013619334, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:25 devstack cinder-volume[86603]: WARNING cinder.quota [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1013619334 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1013619334, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] Created reservations ['ea591ad0-f2a1-484a-a49c-c4f61a70f4a9', '8f827d8e-936d-4eed-bbeb-05da10df2c77', '6e6535ba-0c81-470a-99c5-f6ae81aff414', '59dfabc4-5f3e-4f4f-b118-9c2baacec55c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4c3489f2-d3a5-4ab1-8e1a-1f6e90578285 tempest-GroupSnapshotsV319Test-6485847 None] group_snapshot f53c8d2f-d403-4bf7-8159-0a73c6368a9f: deleted successfully Sep 03 10:59:25 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a 1G" returned: 0 in 0.458s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7965576f-8f04-4d39-8c8e-37855e1a250b -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:26 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7965576f-8f04-4d39-8c8e-37855e1a250b -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a Sep 03 10:59:26 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:26 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7965576f-8f04-4d39-8c8e-37855e1a250b -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a" returned: 0 in 0.324s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:26 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:26 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a Sep 03 10:59:26 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Acquiring lock "cinder-quobyte-c524972a-e284-449a-8bc6-056f1d6a7236" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Lock "cinder-quobyte-c524972a-e284-449a-8bc6-056f1d6a7236" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[977be583-3962-479a-8339-ed861dfb70ef]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:26 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a" returned: 0 in 0.319s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:26 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.info Sep 03 10:59:26 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 Sep 03 10:59:26 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:26 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:26 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.info" returned: 0 in 0.284s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:26 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:26 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236" returned: 0 in 0.423s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:26 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.info Sep 03 10:59:26 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:26 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236 Sep 03 10:59:26 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:27 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.info" returned: 0 in 0.277s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:27 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.957s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1082824815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276fea70-9d1b-4e0a-93c9-527ee6c6c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad832d6130f4f62ac0fc381b7132787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:25Z,use_quota=True,user_id='bcc5bc2c980042cf91e01a9e9cca664f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Creating volume 276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:27 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c524972a-e284-449a-8bc6-056f1d6a7236" returned: 0 in 0.304s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:27 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 1073741824 Sep 03 10:59:27 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Lock "cinder-quobyte-c524972a-e284-449a-8bc6-056f1d6a7236" released by "delete_volume" :: held 0.807s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Created reservations ['e7fd59d2-1682-4c6e-9969-751fd222bac9'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:27 devstack cinder-volume[86603]: WARNING cinder.quota [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1013619334 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1013619334, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:27 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-68fd53c4-3ad9-4537-925e-2800e045c654 tempest-GroupSnapshotsTest-2057996011 None] group_snapshot e3999e3c-4eec-412b-b683-04dc6f98a419: created successfully Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Created reservations ['87f09a2d-9b0e-481e-b3a3-9cb637b925f7', 'c7c0a489-8fa4-402d-96dd-ad02fb28fb7c', 'fe8face0-0361-4ced-ade3-0443d9abc58f', '47df9e49-26bd-49da-a83b-a04990038a66'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:27 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:27 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:27 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 1073741824" returned: 0 in 0.592s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:27 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 Sep 03 10:59:27 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:27 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.333s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:27 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:27 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2dc657ea-0f65-4eb6-a5aa-842c6c3f04b8 tempest-GroupSnapshotsV319Test-6485847 None] Delete group completed successfully. Sep 03 10:59:28 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3" returned: 0 in 0.321s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99745cf9-1e73-41dc-a906-8f0542888629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c72f719-457e-4b0b-83be-de1d002f88ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:28 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] group_snapshot e3999e3c-4eec-412b-b683-04dc6f98a419: deleting Sep 03 10:59:28 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Volume volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 (276fea70-9d1b-4e0a-93c9-527ee6c6c6f3): created successfully Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c72f719-457e-4b0b-83be-de1d002f88ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Flow 'volume_create_manager' (72eb4c33-7cc5-46da-8b77-df98d9ee54a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:28 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3ece0ccd-da2d-422b-8632-fd950f1c0cd1 tempest-AttachVolumeTestJSON-919719381 None] Created volume successfully. Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] group_snapshot e3999e3c-4eec-412b-b683-04dc6f98a419: deleting {{(pid=86603) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-55e7e919-4bea-4780-b942-c0942bd2a118" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-55e7e919-4bea-4780-b942-c0942bd2a118" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Deleting offline snapshot 55e7e919-4bea-4780-b942-c0942bd2a118 of volume db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] snapshot_file for this snap is: volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4b2595-53ae-4df5-96bf-570a5720c09b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:28 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 Sep 03 10:59:28 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:29 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118" returned: 0 in 0.473s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 10:59:29 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb25084-d9c4-4cc2-b1d9-a6f578bece85]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:29 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 Sep 03 10:59:29 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:29 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" returned: 0 in 0.514s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:29 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 Sep 03 10:59:29 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:30 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118" returned: 0 in 0.619s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:30 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118 Sep 03 10:59:30 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:30 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3.55e7e919-4bea-4780-b942-c0942bd2a118" returned: 0 in 0.419s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-55e7e919-4bea-4780-b942-c0942bd2a118" released by "_delete_snapshot" :: held 2.195s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" released by "delete_snapshot" :: held 2.253s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-7965576f-8f04-4d39-8c8e-37855e1a250b" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-7965576f-8f04-4d39-8c8e-37855e1a250b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-b9f8c6b4-e9ae-4ba0-822a-c8774127b14a" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-b9f8c6b4-e9ae-4ba0-822a-c8774127b14a" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Deleting offline snapshot b9f8c6b4-e9ae-4ba0-822a-c8774127b14a of volume 7965576f-8f04-4d39-8c8e-37855e1a250b {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] snapshot_file for this snap is: volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e33cc354-2d01-4501-831b-0bd9c7c08451 req-4b4aebd2-4683-4bb9-8084-be6c3a48c93b tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e33cc354-2d01-4501-831b-0bd9c7c08451 req-4b4aebd2-4683-4bb9-8084-be6c3a48c93b tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8de5b95-76d1-4e7a-8344-010be9fc37f4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e33cc354-2d01-4501-831b-0bd9c7c08451 req-4b4aebd2-4683-4bb9-8084-be6c3a48c93b tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-e33cc354-2d01-4501-831b-0bd9c7c08451 req-4b4aebd2-4683-4bb9-8084-be6c3a48c93b tempest-AttachVolumeTestJSON-919719381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02796097-6c05-4990-b560-f36f188d7993', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 10:59:30 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a Sep 03 10:59:30 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-e33cc354-2d01-4501-831b-0bd9c7c08451 req-4b4aebd2-4683-4bb9-8084-be6c3a48c93b tempest-AttachVolumeTestJSON-919719381 None] attachment_update completed successfully. Sep 03 10:59:31 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a" returned: 0 in 0.499s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7965576f-8f04-4d39-8c8e-37855e1a250b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 10:59:31 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7266853d-0a2b-4593-9d13-ea2eff8db327]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:31 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b Sep 03 10:59:31 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:31 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b" returned: 0 in 0.565s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:32 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a Sep 03 10:59:32 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:32 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a" returned: 0 in 0.399s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:32 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a Sep 03 10:59:32 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:32 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b.b9f8c6b4-e9ae-4ba0-822a-c8774127b14a" returned: 0 in 0.305s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-b9f8c6b4-e9ae-4ba0-822a-c8774127b14a" released by "_delete_snapshot" :: held 1.922s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-7965576f-8f04-4d39-8c8e-37855e1a250b" released by "delete_snapshot" :: held 1.979s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:32 devstack cinder-volume[86603]: WARNING cinder.quota [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-654835041 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-654835041, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:32 devstack cinder-volume[86603]: WARNING cinder.quota [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-654835041 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-654835041, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:32 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['5d72b4af-91bf-40f3-b4b1-530a1776460a', '6c44400f-517f-4af9-9c54-af3a9665a50e', '702fbea0-1063-4a1b-b06c-d76060982da2', '513dfeb4-c6f2-45a9-baa9-e31ffb21ff38'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['63358df9-09f4-483d-872f-fd25a201b0ae', '8a717727-3d2a-4fe5-83e5-209e2d75289a', '6766cb0d-6467-40e4-a71d-700e1250c49f', 'b7a1917d-2863-4848-8d48-8a7f53409734'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:33 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7e797bec-f1a1-44bc-8fa6-0170c525b1ad tempest-GroupSnapshotsTest-2057996011 None] group_snapshot e3999e3c-4eec-412b-b683-04dc6f98a419: deleted successfully Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Flow 'volume_create_manager' (982adab1-c45b-45a9-898b-06ec5851e3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73f379b-492f-4142-b59d-8d3b3971df32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=146,cinder:UPDATE=135,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73f379b-492f-4142-b59d-8d3b3971df32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-198575503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843516a6-bd35-4462-8e41-436608a9e6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad832d6130f4f62ac0fc381b7132787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:34Z,use_quota=True,user_id='bcc5bc2c980042cf91e01a9e9cca664f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68890c79-569e-4dcf-9b2e-6fb656d6fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68890c79-569e-4dcf-9b2e-6fb656d6fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e8ea2b-32a3-4b36-9ccd-ef728e9d0f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e8ea2b-32a3-4b36-9ccd-ef728e9d0f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843516a6-bd35-4462-8e41-436608a9e6db', 'volume_name': 'volume-843516a6-bd35-4462-8e41-436608a9e6db', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e72d5f4-7292-4a45-a236-34c2f5dc5460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e72d5f4-7292-4a45-a236-34c2f5dc5460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6c0172-9b26-4cf4-866d-1e72648c7408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:33 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Volume 843516a6-bd35-4462-8e41-436608a9e6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843516a6-bd35-4462-8e41-436608a9e6db', 'volume_size': 1} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-198575503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843516a6-bd35-4462-8e41-436608a9e6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad832d6130f4f62ac0fc381b7132787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:34Z,use_quota=True,user_id='bcc5bc2c980042cf91e01a9e9cca664f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Creating volume 843516a6-bd35-4462-8e41-436608a9e6db {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:33 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:33 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db 1073741824 Sep 03 10:59:33 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:34 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db 1073741824" returned: 0 in 0.951s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:34 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=150,cinder:UPDATE=159,cinder:INSERT=36,cinder:DELETE=3 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 10:59:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:34 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db Sep 03 10:59:34 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-7965576f-8f04-4d39-8c8e-37855e1a250b" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-7965576f-8f04-4d39-8c8e-37855e1a250b" acquired by "delete_volume" :: waited 0.067s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7211d7b-03d1-441e-8017-98fccbeb729b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:35 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b Sep 03 10:59:35 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:35 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db" returned: 0 in 0.578s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6c0172-9b26-4cf4-866d-1e72648c7408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843516a6-bd35-4462-8e41-436608a9e6db', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986e2d57-4d10-4e0e-9b83-8fa2f99e36fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:35 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Volume volume-843516a6-bd35-4462-8e41-436608a9e6db (843516a6-bd35-4462-8e41-436608a9e6db): created successfully Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986e2d57-4d10-4e0e-9b83-8fa2f99e36fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Flow 'volume_create_manager' (982adab1-c45b-45a9-898b-06ec5851e3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:35 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9a2953a7-1b75-450e-9f4a-fa0928b8daa2 tempest-AttachVolumeTestJSON-919719381 None] Created volume successfully. Sep 03 10:59:36 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b" returned: 0 in 1.046s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:36 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b Sep 03 10:59:36 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-140512da-763b-4735-adf8-f106217e985d tempest-GroupsTest-1643513886 None] Group tempest-Group1-1792406919: creating Sep 03 10:59:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-140512da-763b-4735-adf8-f106217e985d tempest-GroupsTest-1643513886 None] Group tempest-Group1-1792406919: created successfully Sep 03 10:59:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-140512da-763b-4735-adf8-f106217e985d tempest-GroupsTest-1643513886 None] Create group completed successfully. Sep 03 10:59:36 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7965576f-8f04-4d39-8c8e-37855e1a250b" returned: 0 in 0.695s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-7965576f-8f04-4d39-8c8e-37855e1a250b" released by "delete_volume" :: held 1.884s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:37 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[75626c43-eb9b-4f3b-a337-966f62787dfb]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:37 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 Sep 03 10:59:37 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-729ac060-9e21-47e1-95c8-cf957ebea4e1 req-d21ce632-ec42-45cc-a81a-8b1905232927 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-729ac060-9e21-47e1-95c8-cf957ebea4e1 req-d21ce632-ec42-45cc-a81a-8b1905232927 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-729ac060-9e21-47e1-95c8-cf957ebea4e1 req-d21ce632-ec42-45cc-a81a-8b1905232927 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-729ac060-9e21-47e1-95c8-cf957ebea4e1 req-d21ce632-ec42-45cc-a81a-8b1905232927 tempest-AttachVolumeTestJSON-919719381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-843516a6-bd35-4462-8e41-436608a9e6db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75f5806c-b812-4408-a87f-9cbabeff6fe5', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 10:59:37 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" returned: 0 in 0.500s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-729ac060-9e21-47e1-95c8-cf957ebea4e1 req-d21ce632-ec42-45cc-a81a-8b1905232927 tempest-AttachVolumeTestJSON-919719381 None] attachment_update completed successfully. Sep 03 10:59:37 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3 Sep 03 10:59:37 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4cac3001-32aa-48d5-95ce-fbda866306f4 tempest-GroupsTest-1643513886 None] Group tempest-Group2-1325102610: creating Sep 03 10:59:38 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" returned: 0 in 0.406s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:38 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4cac3001-32aa-48d5-95ce-fbda866306f4 tempest-GroupsTest-1643513886 None] Group tempest-Group2-1325102610: created successfully Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-db5fd1d3-fcc9-4c14-b3aa-4956a54f26f3" released by "delete_volume" :: held 1.082s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:38 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4cac3001-32aa-48d5-95ce-fbda866306f4 tempest-GroupsTest-1643513886 None] Create group completed successfully. Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['326ca648-27d9-4ac7-a407-14efff28eafb'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:38 devstack cinder-volume[86603]: WARNING cinder.quota [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-654835041 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-654835041, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['eec78b44-d2f6-4791-a27e-ab84cd8cbc66', '5c9c960b-f591-40f7-b45b-04a935b6ebc0', 'f6ed99c5-16f8-409f-821c-970ef131082e', '59d193fd-a9e7-4949-b1b4-cb7165a93dd5'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['b54e9f39-f6f3-4cc1-8f48-f27b2b847063', '65b7fb99-5a63-4ed1-851a-fded1b434a79', 'b4495d7c-11c6-4ee5-a1f3-18b0f49dd4ec', 'ebef3979-0b4b-4c85-9582-3c7a9f7486d0'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:38 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:38 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:39 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.311s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-84b4d0ca-d0e4-48ac-863b-90322e61f7ce tempest-GroupSnapshotsTest-2057996011 None] Delete group completed successfully. Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Flow 'volume_create_manager' (5ad5d2de-a423-4625-a7c6-e9e8a77113f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb28cb0-d142-440b-b30e-96381015827e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb28cb0-d142-440b-b30e-96381015827e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-112728914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b77822ae-e5fd-4c5f-8f93-d5ea9b5864db,host='devstack@QuobyteHD#QuobyteHD',id=98b558cc-0ef6-4da6-a886-e6582e1602df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a601626d9f49b2bc6d1a1f8e5f386b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:40Z,use_quota=True,user_id='963ea52cc7304aae9951a97cbeffe169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(558d0394-8dc1-4ae7-aa81-b2e2639ea83e),volume_type_id=558d0394-8dc1-4ae7-aa81-b2e2639ea83e)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381d2b40-9d3d-4267-84d6-a5fd7ae8f4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381d2b40-9d3d-4267-84d6-a5fd7ae8f4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfa7950-3133-405d-9832-4900176f652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfa7950-3133-405d-9832-4900176f652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b558cc-0ef6-4da6-a886-e6582e1602df', 'volume_name': 'volume-98b558cc-0ef6-4da6-a886-e6582e1602df', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44557792-c653-463f-8284-2a821172092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44557792-c653-463f-8284-2a821172092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84645634-99f8-482d-8a73-05a59bb604cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:39 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Volume 98b558cc-0ef6-4da6-a886-e6582e1602df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b558cc-0ef6-4da6-a886-e6582e1602df', 'volume_size': 1} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b77822ae-e5fd-4c5f-8f93-d5ea9b5864db,created_at=2026-09-03T08:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-112728914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b77822ae-e5fd-4c5f-8f93-d5ea9b5864db,host='devstack@QuobyteHD#QuobyteHD',id=98b558cc-0ef6-4da6-a886-e6582e1602df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a601626d9f49b2bc6d1a1f8e5f386b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:40Z,use_quota=True,user_id='963ea52cc7304aae9951a97cbeffe169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(558d0394-8dc1-4ae7-aa81-b2e2639ea83e),volume_type_id=558d0394-8dc1-4ae7-aa81-b2e2639ea83e)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Creating volume 98b558cc-0ef6-4da6-a886-e6582e1602df {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:40 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:40 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df 1073741824 Sep 03 10:59:40 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9be1fdb4-d0a1-406d-9272-bcbdf117bdc9 tempest-GroupSnapshotsTest-2057996011 None] Group tempest-GroupSnapshotsTest-Group-28358644: creating Sep 03 10:59:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9be1fdb4-d0a1-406d-9272-bcbdf117bdc9 tempest-GroupSnapshotsTest-2057996011 None] Group tempest-GroupSnapshotsTest-Group-28358644: created successfully Sep 03 10:59:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9be1fdb4-d0a1-406d-9272-bcbdf117bdc9 tempest-GroupSnapshotsTest-2057996011 None] Create group completed successfully. Sep 03 10:59:40 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df 1073741824" returned: 0 in 0.777s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:40 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df Sep 03 10:59:40 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-24dedc0c-0d83-4d96-a133-ebf5272c0a4e req-b2b1cbb2-72b9-46cf-8eb5-b48fba47704e tempest-AttachVolumeTestJSON-919719381 None] Terminate volume connection completed successfully. Sep 03 10:59:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-24dedc0c-0d83-4d96-a133-ebf5272c0a4e req-b2b1cbb2-72b9-46cf-8eb5-b48fba47704e tempest-AttachVolumeTestJSON-919719381 None] Deleting attachment 02796097-6c05-4990-b560-f36f188d7993. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:59:41 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df" returned: 0 in 0.334s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84645634-99f8-482d-8a73-05a59bb604cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b558cc-0ef6-4da6-a886-e6582e1602df', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea8243e-2728-454e-87e7-de2884902554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:41 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Volume volume-98b558cc-0ef6-4da6-a886-e6582e1602df (98b558cc-0ef6-4da6-a886-e6582e1602df): created successfully Sep 03 10:59:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea8243e-2728-454e-87e7-de2884902554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Flow 'volume_create_manager' (5ad5d2de-a423-4625-a7c6-e9e8a77113f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b2b04c46-c641-4d27-a643-581bb5a56da8 tempest-GroupsTest-1643513886 None] Created volume successfully. Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Flow 'volume_create_manager' (43d17119-a846-4213-8cbd-cebc9a9a0bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182376ad-7a72-4def-92d7-cfe77ccdcc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182376ad-7a72-4def-92d7-cfe77ccdcc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102361550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56bc9e86-55d3-43a2-9f1a-64e3fc0e13c9,host='devstack@QuobyteHD#QuobyteHD',id=eaff2989-1462-4119-8d00-2fc22c9ac2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da051b8f372246609a9a70737a53df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:42Z,use_quota=True,user_id='2a16b6f2951e441fa42de06ef30ba258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db015656-2ba3-4538-b5f1-31400542ba9d),volume_type_id=db015656-2ba3-4538-b5f1-31400542ba9d)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2647da-4ecb-4002-b5c8-032f86575c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2647da-4ecb-4002-b5c8-032f86575c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84f28ef-e190-4510-b0c9-6ede68dd8543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84f28ef-e190-4510-b0c9-6ede68dd8543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaff2989-1462-4119-8d00-2fc22c9ac2c3', 'volume_name': 'volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8044834a-8602-4de4-a486-02c920fdf53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8044834a-8602-4de4-a486-02c920fdf53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc83cc7-8c3f-4b78-8981-3a53c632887f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:42 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Volume eaff2989-1462-4119-8d00-2fc22c9ac2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3', 'volume_size': 1} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56bc9e86-55d3-43a2-9f1a-64e3fc0e13c9,created_at=2026-09-03T08:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102361550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56bc9e86-55d3-43a2-9f1a-64e3fc0e13c9,host='devstack@QuobyteHD#QuobyteHD',id=eaff2989-1462-4119-8d00-2fc22c9ac2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da051b8f372246609a9a70737a53df9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:42Z,use_quota=True,user_id='2a16b6f2951e441fa42de06ef30ba258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db015656-2ba3-4538-b5f1-31400542ba9d),volume_type_id=db015656-2ba3-4538-b5f1-31400542ba9d)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Creating volume eaff2989-1462-4119-8d00-2fc22c9ac2c3 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:42 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:42 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 1073741824 Sep 03 10:59:42 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:42 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-e7b49daa-9035-4eb7-bd8b-7c5a58919c48 req-4e859cbf-66da-4649-a676-861ca0055374 tempest-AttachVolumeTestJSON-919719381 None] Terminate volume connection completed successfully. Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-e7b49daa-9035-4eb7-bd8b-7c5a58919c48 req-4e859cbf-66da-4649-a676-861ca0055374 tempest-AttachVolumeTestJSON-919719381 None] Deleting attachment 75f5806c-b812-4408-a87f-9cbabeff6fe5. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 10:59:42 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 1073741824" returned: 0 in 0.604s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:43 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 Sep 03 10:59:43 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Acquiring lock "cinder-quobyte-98b558cc-0ef6-4da6-a886-e6582e1602df" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Lock "cinder-quobyte-98b558cc-0ef6-4da6-a886-e6582e1602df" acquired by "delete_volume" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7e9a85-7cd1-4489-b484-88708d36a62e]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:43 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3" returned: 0 in 0.343s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc83cc7-8c3f-4b78-8981-3a53c632887f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547b6dc5-89a4-4498-85bb-2d4da510faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:43 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Volume volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 (eaff2989-1462-4119-8d00-2fc22c9ac2c3): created successfully Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547b6dc5-89a4-4498-85bb-2d4da510faa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Flow 'volume_create_manager' (43d17119-a846-4213-8cbd-cebc9a9a0bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-dbfbd09b-f70e-48af-85fd-1800062b032e tempest-GroupSnapshotsTest-2057996011 None] Created volume successfully. Sep 03 10:59:43 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df Sep 03 10:59:43 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] GroupSnapshot eb3c562d-42a2-4f81-a21b-c1752e31f249: creating. Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Group snapshot eb3c562d-42a2-4f81-a21b-c1752e31f249: creating. {{(pid=86603) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:43 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df" returned: 0 in 0.618s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Creating offline snapshot aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 of volume eaff2989-1462-4119-8d00-2fc22c9ac2c3 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 10:59:43 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df Sep 03 10:59:43 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ef3f92-b55b-4493-abb4-d5a37a75fa71]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:44 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 Sep 03 10:59:44 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:44 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-98b558cc-0ef6-4da6-a886-e6582e1602df" returned: 0 in 0.369s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Lock "cinder-quobyte-98b558cc-0ef6-4da6-a886-e6582e1602df" released by "delete_volume" :: held 1.055s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Created reservations ['489d9114-a3c4-4b8c-8434-abc61d9ce5b3'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:44 devstack cinder-volume[86603]: WARNING cinder.quota [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-464212540 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-464212540, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:44 devstack cinder-volume[86603]: WARNING cinder.quota [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-464212540 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-464212540, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:44 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Created reservations ['fbbfb5f7-fd36-4bc2-a754-b0d2d7edf043', 'eb4cd8af-4ed9-4f79-8db3-3ddd7b3c8f00', 'c5b9166b-8c0c-4f45-a2e0-7f32b5b4a8dd', '94fa7717-47b8-4316-a1a6-c3ba879cad23'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3" returned: 0 in 0.603s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:44 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 1G Sep 03 10:59:44 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:45 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:45 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:45 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.375s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:45 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:45 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-359a0408-6488-489f-9272-91b77dbba126 tempest-GroupsTest-1643513886 None] Delete group completed successfully. Sep 03 10:59:45 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 1G" returned: 0 in 0.810s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:45 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 Sep 03 10:59:45 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:45 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53" returned: 0 in 0.507s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:45 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:59:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:45 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 Sep 03 10:59:45 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] Created reservations ['94e67f5f-97e3-4dbe-b9a4-dc907224a5c5'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:46 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:46 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:46 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53" returned: 0 in 0.407s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:46 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.info Sep 03 10:59:46 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:46 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.390s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:46 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1869c9f1-de07-46c4-b1d1-9213cbb1691d tempest-GroupsTest-1643513886 None] Delete group completed successfully. Sep 03 10:59:46 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.info" returned: 0 in 0.425s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:46 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 10:59:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:46 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.info Sep 03 10:59:46 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:47 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.info" returned: 0 in 0.287s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.182s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-61821889-6624-4e4a-8f88-f99f4c166f18 tempest-GroupSnapshotsTest-2057996011 None] group_snapshot eb3c562d-42a2-4f81-a21b-c1752e31f249: created successfully Sep 03 10:59:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] group_snapshot eb3c562d-42a2-4f81-a21b-c1752e31f249: deleting Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] group_snapshot eb3c562d-42a2-4f81-a21b-c1752e31f249: deleting {{(pid=86603) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-eaff2989-1462-4119-8d00-2fc22c9ac2c3" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-eaff2989-1462-4119-8d00-2fc22c9ac2c3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-aa533fa8-b3d9-4fa4-94cd-20c1762d1c53" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-aa533fa8-b3d9-4fa4-94cd-20c1762d1c53" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Deleting offline snapshot aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 of volume eaff2989-1462-4119-8d00-2fc22c9ac2c3 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] snapshot_file for this snap is: volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6c35ef-4e01-4ddd-82ca-a92d7be24299]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:48 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 Sep 03 10:59:48 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-fec7ecc8-464f-4c95-8010-cd865c240b58 tempest-GroupsTest-1643513886 None] Group tempest-GroupsTest-Group-1757185537: creating Sep 03 10:59:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-fec7ecc8-464f-4c95-8010-cd865c240b58 tempest-GroupsTest-1643513886 None] Group tempest-GroupsTest-Group-1757185537: created successfully Sep 03 10:59:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-fec7ecc8-464f-4c95-8010-cd865c240b58 tempest-GroupsTest-1643513886 None] Create group completed successfully. Sep 03 10:59:48 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53" returned: 0 in 0.546s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "cinder-843516a6-bd35-4462-8e41-436608a9e6db-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7c0ecb-7b48-4f36-95c3-4f001f2fee76]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-843516a6-bd35-4462-8e41-436608a9e6db-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "cinder-quobyte-843516a6-bd35-4462-8e41-436608a9e6db" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-quobyte-843516a6-bd35-4462-8e41-436608a9e6db" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aad92d0-50ad-4857-a90d-47a24d51b969]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:48 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 Sep 03 10:59:48 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:48 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db Sep 03 10:59:48 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:48 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3" returned: 0 in 0.407s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:48 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 Sep 03 10:59:48 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:49 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db" returned: 0 in 0.369s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:49 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db Sep 03 10:59:49 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:49 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53" returned: 0 in 0.355s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:49 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-843516a6-bd35-4462-8e41-436608a9e6db" returned: 0 in 0.274s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:49 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53 Sep 03 10:59:49 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-quobyte-843516a6-bd35-4462-8e41-436608a9e6db" released by "delete_volume" :: held 0.694s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Created reservations ['b9e0ed4e-eb19-433a-9293-d69477babf2d', 'c8cdf29d-01d3-454b-8e88-97be8711b9b3', 'd00c8624-89a5-4a90-bd3d-5e5a795bfa41', '09966c4c-0d12-4196-b8a8-f83adadcc980'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:49 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:49 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:49 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3.aa533fa8-b3d9-4fa4-94cd-20c1762d1c53" returned: 0 in 0.302s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-aa533fa8-b3d9-4fa4-94cd-20c1762d1c53" released by "_delete_snapshot" :: held 1.788s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-eaff2989-1462-4119-8d00-2fc22c9ac2c3" released by "delete_snapshot" :: held 1.834s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "cinder-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:49 devstack cinder-volume[86603]: WARNING cinder.quota [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1564143354 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1564143354, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:49 devstack cinder-volume[86603]: WARNING cinder.quota [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1564143354 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1564143354, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:49 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.413s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['121032d8-3ecb-4739-88a9-62d4e5848833', '2e63e618-4f5c-4a21-9ada-90fd155c7df9', '114b2023-6382-4cc6-96e5-90567d7df08d', '16e5030b-6c60-4a06-a0f7-ca82f1c30bd5'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Deleted volume successfully. Sep 03 10:59:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "cinder-quobyte-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Flow 'volume_create_manager' (1504ac25-ed34-4e5d-a993-90769feb1642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa4a882-1251-43d4-81a2-51050e509f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-quobyte-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3" acquired by "delete_volume" :: waited 0.052s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2637e041-36cb-4781-907f-792a5848ed56 tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-843516a6-bd35-4462-8e41-436608a9e6db-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa4a882-1251-43d4-81a2-51050e509f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-578571761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc89fc8f-2551-4a10-99ff-47cb2dc1a78f,host='devstack@QuobyteHD#QuobyteHD',id=11e0e303-4bed-424e-8b60-7ba2debe20e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a601626d9f49b2bc6d1a1f8e5f386b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:50Z,use_quota=True,user_id='963ea52cc7304aae9951a97cbeffe169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e852e813-b8ad-4bef-8292-beabafc2c247),volume_type_id=e852e813-b8ad-4bef-8292-beabafc2c247)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2218e25b-09af-4ced-8f6f-3e2b6f2bacb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2218e25b-09af-4ced-8f6f-3e2b6f2bacb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aa172c-96f5-47cf-a061-09253cb2e898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aa172c-96f5-47cf-a061-09253cb2e898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e0e303-4bed-424e-8b60-7ba2debe20e1', 'volume_name': 'volume-11e0e303-4bed-424e-8b60-7ba2debe20e1', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bbd5dd-df3b-4a73-9924-65138066542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bbd5dd-df3b-4a73-9924-65138066542d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5d6ce2-22ca-4803-809a-0fe4a4f39595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:50 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Volume 11e0e303-4bed-424e-8b60-7ba2debe20e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e0e303-4bed-424e-8b60-7ba2debe20e1', 'volume_size': 1} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc89fc8f-2551-4a10-99ff-47cb2dc1a78f,created_at=2026-09-03T08:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-578571761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc89fc8f-2551-4a10-99ff-47cb2dc1a78f,host='devstack@QuobyteHD#QuobyteHD',id=11e0e303-4bed-424e-8b60-7ba2debe20e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a601626d9f49b2bc6d1a1f8e5f386b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:50Z,use_quota=True,user_id='963ea52cc7304aae9951a97cbeffe169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e852e813-b8ad-4bef-8292-beabafc2c247),volume_type_id=e852e813-b8ad-4bef-8292-beabafc2c247)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Creating volume 11e0e303-4bed-424e-8b60-7ba2debe20e1 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:50 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f4a79e-3149-43b4-97ea-1c85c7d233b8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:50 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 1073741824 Sep 03 10:59:50 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:50 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d8b0f7b0-0abd-4498-bf8b-30fed5bd75f3 tempest-GroupSnapshotsTest-2057996011 None] group_snapshot eb3c562d-42a2-4f81-a21b-c1752e31f249: deleted successfully Sep 03 10:59:50 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 Sep 03 10:59:50 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "cinder-quobyte-eaff2989-1462-4119-8d00-2fc22c9ac2c3" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-eaff2989-1462-4119-8d00-2fc22c9ac2c3" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:50 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3" returned: 0 in 0.465s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067a3de-1b2b-42e6-8f7d-c0f5f2ef89be]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:50 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3 Sep 03 10:59:50 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:50 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 1073741824" returned: 0 in 0.522s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:50 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 Sep 03 10:59:50 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:50 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 Sep 03 10:59:50 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:50 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3" returned: 0 in 0.287s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-quobyte-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3" released by "delete_volume" :: held 0.865s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Created reservations ['8a620208-dc48-4173-ac27-94fee68f84bc', '90c243c4-2de8-409a-a994-a9faf02494e5', '91ba041d-d6f4-46bf-af10-6cfb027e9943', '0ff3fdda-281c-472a-9693-7f79f733321e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:50 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1" returned: 0 in 0.305s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5d6ce2-22ca-4803-809a-0fe4a4f39595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e0e303-4bed-424e-8b60-7ba2debe20e1', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f95ba25-d28d-408a-85f2-1f038991b085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:51 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Volume volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 (11e0e303-4bed-424e-8b60-7ba2debe20e1): created successfully Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f95ba25-d28d-408a-85f2-1f038991b085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Flow 'volume_create_manager' (1504ac25-ed34-4e5d-a993-90769feb1642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:51 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3" returned: 0 in 0.439s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:51 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5d3b530e-3716-4320-a94d-dd5a163130d8 tempest-GroupsTest-1643513886 None] Created volume successfully. Sep 03 10:59:51 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3 Sep 03 10:59:51 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:51 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:51 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:51 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff2989-1462-4119-8d00-2fc22c9ac2c3" returned: 0 in 0.257s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Lock "cinder-quobyte-eaff2989-1462-4119-8d00-2fc22c9ac2c3" released by "delete_volume" :: held 0.772s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:51 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.250s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:51 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Deleted volume successfully. Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c28ed6c0-4626-4967-9a06-bbb69763c7fc tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-276fea70-9d1b-4e0a-93c9-527ee6c6c6f3-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['ef83094a-fbe4-4b02-9652-57b23bedd99d'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:51 devstack cinder-volume[86603]: WARNING cinder.quota [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1564143354 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1564143354, it is now deprecated. Please use the default quota class for default quota. Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Created reservations ['a756ce28-30eb-44d9-9538-0225d5d3262b', '306142f1-2586-4f4f-9064-be77379f5cd2', '1e4f17fd-6ef6-4671-8037-034a6ef955a2', '9bc4945f-fe24-4e44-a9ed-de94e6b01484'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:51 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:51 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:51 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.251s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:51 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:51 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-297446b4-4344-4791-9d1e-b26bfc4e76af tempest-GroupSnapshotsTest-2057996011 None] Delete group completed successfully. Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "cinder-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "cinder-quobyte-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-quobyte-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c47d3-afef-4279-b8f4-676d704fc3c7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:52 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 Sep 03 10:59:52 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:52 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311" returned: 0 in 0.450s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:52 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311 Sep 03 10:59:52 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:52 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311" returned: 0 in 0.302s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-quobyte-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311" released by "delete_volume" :: held 0.802s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:52 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Flow 'volume_create_manager' (61af6723-de30-4cac-9309-5160d22e81f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6498a99-8bf9-452d-b943-cb299651b309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6498a99-8bf9-452d-b943-cb299651b309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T08:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1299742280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc89fc8f-2551-4a10-99ff-47cb2dc1a78f,host='devstack@QuobyteHD#QuobyteHD',id=97349306-fb17-48a8-8a32-0a2fc23c5be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a601626d9f49b2bc6d1a1f8e5f386b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:53Z,use_quota=True,user_id='963ea52cc7304aae9951a97cbeffe169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e852e813-b8ad-4bef-8292-beabafc2c247),volume_type_id=e852e813-b8ad-4bef-8292-beabafc2c247)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952bd4d0-3505-49cf-a5ae-1a2161db073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952bd4d0-3505-49cf-a5ae-1a2161db073c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a7ae78-eac7-43fb-81ea-46dcd35f922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a7ae78-eac7-43fb-81ea-46dcd35f922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97349306-fb17-48a8-8a32-0a2fc23c5be8', 'volume_name': 'volume-97349306-fb17-48a8-8a32-0a2fc23c5be8', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d09c96c-4f14-4371-bb9e-3be809092a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d09c96c-4f14-4371-bb9e-3be809092a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6542f2c-a458-458e-868f-2c8c7d07938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:53 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Volume 97349306-fb17-48a8-8a32-0a2fc23c5be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97349306-fb17-48a8-8a32-0a2fc23c5be8', 'volume_size': 1} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc89fc8f-2551-4a10-99ff-47cb2dc1a78f,created_at=2026-09-03T08:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1299742280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc89fc8f-2551-4a10-99ff-47cb2dc1a78f,host='devstack@QuobyteHD#QuobyteHD',id=97349306-fb17-48a8-8a32-0a2fc23c5be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a601626d9f49b2bc6d1a1f8e5f386b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T08:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T08:59:53Z,use_quota=True,user_id='963ea52cc7304aae9951a97cbeffe169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e852e813-b8ad-4bef-8292-beabafc2c247),volume_type_id=e852e813-b8ad-4bef-8292-beabafc2c247)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Creating volume 97349306-fb17-48a8-8a32-0a2fc23c5be8 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 10:59:53 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:53 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 1073741824 Sep 03 10:59:53 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Created reservations ['bb549cad-7ca0-4113-94b5-9837f452c4e4', 'e20daf98-5001-4efe-b9a4-7af5b44f0fe0', '1d97fc93-a75f-495d-bd4c-3481fc20a9ca', '2c9d08bc-17d4-433d-8c90-a46784b4dad9'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:53 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 10:59:53 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:53 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.348s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 10:59:53 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Deleted volume successfully. Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a581cb29-24a9-4ab6-b796-a01af5709c33 tempest-AttachVolumeTestJSON-919719381 None] Lock "cinder-f93ceb2f-c4bb-40ae-9fa4-96b1177ea311-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:53 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 1073741824" returned: 0 in 0.701s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:53 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 Sep 03 10:59:53 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:54 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8" returned: 0 in 0.363s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 10:59:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 10:59:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6542f2c-a458-458e-868f-2c8c7d07938f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97349306-fb17-48a8-8a32-0a2fc23c5be8', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a002efd-335c-421b-a2ca-d82eb3ac8a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 10:59:54 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Volume volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 (97349306-fb17-48a8-8a32-0a2fc23c5be8): created successfully Sep 03 10:59:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a002efd-335c-421b-a2ca-d82eb3ac8a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 10:59:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Flow 'volume_create_manager' (61af6723-de30-4cac-9309-5160d22e81f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 10:59:54 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-14a0eabc-2fba-436a-a14b-65893d76a23d tempest-GroupsTest-1643513886 None] Created volume successfully. Sep 03 10:59:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-52f097c2-13f4-41bd-b85b-b59fd6d6ae67 tempest-GroupsTest-1643513886 None] Update group completed successfully. Sep 03 10:59:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6eb6ca2a-5c50-4e82-a491-08f425ae97e9 tempest-GroupsTest-1643513886 None] Update group completed successfully. Sep 03 10:59:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Acquiring lock "cinder-quobyte-11e0e303-4bed-424e-8b60-7ba2debe20e1" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Lock "cinder-quobyte-11e0e303-4bed-424e-8b60-7ba2debe20e1" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:58 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[30559ae6-2d26-4cfe-bb59-4547488648a4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:59 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 Sep 03 10:59:59 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:59 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1" returned: 0 in 0.543s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 10:59:59 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1 Sep 03 10:59:59 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 10:59:59 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Sep 03 10:59:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11e0e303-4bed-424e-8b60-7ba2debe20e1" returned: 0 in 0.403s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 10:59:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Lock "cinder-quobyte-11e0e303-4bed-424e-8b60-7ba2debe20e1" released by "delete_volume" :: held 1.013s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 10:59:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Acquiring lock "cinder-quobyte-97349306-fb17-48a8-8a32-0a2fc23c5be8" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 10:59:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Lock "cinder-quobyte-97349306-fb17-48a8-8a32-0a2fc23c5be8" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 10:59:59 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7afb44-9523-4e52-b304-e106e5e3325b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 10:59:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:00 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 Sep 03 11:00:00 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Flow 'volume_create_manager' (3ee627c3-a04d-4e91-b0ea-f77ccc530ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da4ca12-cdec-482f-b950-b6eca757d161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da4ca12-cdec-482f-b950-b6eca757d161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1437428081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a5497a-88f1-41d2-b415-07bcf1a9873e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a61289c99f4361ae0d3d4c5b0ba464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:00:00Z,use_quota=True,user_id='46519b3aef934be88060a93bf28345fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334fdeba-0d1e-4b2c-996f-50f972e826c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334fdeba-0d1e-4b2c-996f-50f972e826c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7293d166-6554-4a43-86ee-f2d524d63a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7293d166-6554-4a43-86ee-f2d524d63a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a5497a-88f1-41d2-b415-07bcf1a9873e', 'volume_name': 'volume-20a5497a-88f1-41d2-b415-07bcf1a9873e', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e4acd9-6ec6-4d6c-8888-19033686341b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e4acd9-6ec6-4d6c-8888-19033686341b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d6639b-0e61-41e5-808d-b2e5a23980be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:00 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Volume 20a5497a-88f1-41d2-b415-07bcf1a9873e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a5497a-88f1-41d2-b415-07bcf1a9873e', 'volume_size': 1} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1437428081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a5497a-88f1-41d2-b415-07bcf1a9873e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a61289c99f4361ae0d3d4c5b0ba464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:00:00Z,use_quota=True,user_id='46519b3aef934be88060a93bf28345fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Creating volume 20a5497a-88f1-41d2-b415-07bcf1a9873e {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:00:00 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:00 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e 1073741824 Sep 03 11:00:00 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:00 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8" returned: 0 in 0.589s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:00 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8 Sep 03 11:00:00 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:00 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-97349306-fb17-48a8-8a32-0a2fc23c5be8" returned: 0 in 0.331s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Lock "cinder-quobyte-97349306-fb17-48a8-8a32-0a2fc23c5be8" released by "delete_volume" :: held 1.001s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Created reservations ['e2ced3b3-53e6-4955-8128-8124a5835098'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:01 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e 1073741824" returned: 0 in 0.628s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:01 devstack cinder-volume[86603]: WARNING cinder.quota [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-127690517 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-127690517, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:00:01 devstack cinder-volume[86603]: WARNING cinder.quota [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-127690517 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-127690517, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Created reservations ['815f556e-a2b2-440d-a784-0eb9859623d5', 'ab9d936e-8e40-49e9-897b-7a2355a0a465', '7d87ab0b-f135-41f0-a1c9-319e52c99642', '45e7752b-b764-474d-80c4-f464fcc502eb'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:01 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e Sep 03 11:00:01 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Created reservations ['279471ee-0719-4d13-aff8-5344fa591cd9', 'eec9ae6a-3a88-420a-9b00-12afd8d15726', 'e95b570e-7ed5-442c-a8bc-7dd5c35f8d42', '97b7c667-e95f-49bf-b32b-5401bfae9da3'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:01 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e" returned: 0 in 0.306s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d6639b-0e61-41e5-808d-b2e5a23980be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a5497a-88f1-41d2-b415-07bcf1a9873e', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16ecee8-e14b-48c3-b89f-5eee38bf01f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Volume volume-20a5497a-88f1-41d2-b415-07bcf1a9873e (20a5497a-88f1-41d2-b415-07bcf1a9873e): created successfully Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16ecee8-e14b-48c3-b89f-5eee38bf01f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Flow 'volume_create_manager' (3ee627c3-a04d-4e91-b0ea-f77ccc530ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:00:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ffbb000e-9e22-4c95-acf8-080b2a14d9c8 tempest-AttachVolumeNegativeTest-1675740208 None] Created volume successfully. Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:01 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:00:01 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:01 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.261s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:01 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:00:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-fb1a21e5-7f35-4237-a9e1-481c25654fb3 tempest-GroupsTest-1643513886 None] Delete group completed successfully. Sep 03 11:00:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-598dc05b-cb9c-455d-8765-9f2871ccf32c tempest-BackendsCapabilitiesAdminTestsJSON-1961872151 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8575019836426, 'free_capacity_gb': 1773.8575019836426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86603) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 11:00:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5c7e7173-f023-47d3-810b-6e54b9e25961 tempest-BackendsCapabilitiesAdminTestsJSON-1961872151 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8575019836426, 'free_capacity_gb': 1773.8575019836426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86603) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 11:00:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-454f07bf-506b-4cee-b38c-a1739c0327bb req-879cddea-2b86-4856-b4e3-9ee3495a582d tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-454f07bf-506b-4cee-b38c-a1739c0327bb req-879cddea-2b86-4856-b4e3-9ee3495a582d tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-454f07bf-506b-4cee-b38c-a1739c0327bb req-879cddea-2b86-4856-b4e3-9ee3495a582d tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-454f07bf-506b-4cee-b38c-a1739c0327bb req-879cddea-2b86-4856-b4e3-9ee3495a582d tempest-AttachVolumeNegativeTest-1675740208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-20a5497a-88f1-41d2-b415-07bcf1a9873e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90ffe7e6-e9af-4154-a9e1-7c1c8ba3080d', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:00:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-454f07bf-506b-4cee-b38c-a1739c0327bb req-879cddea-2b86-4856-b4e3-9ee3495a582d tempest-AttachVolumeNegativeTest-1675740208 None] attachment_update completed successfully. Sep 03 11:00:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e5a4079d-cd8f-41a0-8d4b-d1fc50781bdd tempest-GroupsV314Test-1991986756 None] Group tempest-GroupsV314Test-Group-1674362622: creating Sep 03 11:00:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e5a4079d-cd8f-41a0-8d4b-d1fc50781bdd tempest-GroupsV314Test-1991986756 None] Group tempest-GroupsV314Test-Group-1674362622: created successfully Sep 03 11:00:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e5a4079d-cd8f-41a0-8d4b-d1fc50781bdd tempest-GroupsV314Test-1991986756 None] Create group completed successfully. Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Flow 'volume_create_manager' (120401c3-83a2-45fa-89e6-cdd8da292a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd694c12-bf28-4ba7-af7e-cd41bbef75e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd694c12-bf28-4ba7-af7e-cd41bbef75e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-672111385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07e8de3b-f57c-4f38-9143-3dc1abd74573,host='devstack@QuobyteHD#QuobyteHD',id=0f806f82-d97f-4fd2-be6b-ebb750760f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6a18c0e769446887735387ac90f64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:00:13Z,use_quota=True,user_id='7fd28a0a219442839d964bed26a442d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5a1e7da-8aa4-487a-a0a0-d7fca25cc54f),volume_type_id=c5a1e7da-8aa4-487a-a0a0-d7fca25cc54f)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ce9a0-2de7-4e26-8b49-67816450100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ce9a0-2de7-4e26-8b49-67816450100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c32e47-b3d2-4f59-be72-79e745313fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c32e47-b3d2-4f59-be72-79e745313fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f806f82-d97f-4fd2-be6b-ebb750760f70', 'volume_name': 'volume-0f806f82-d97f-4fd2-be6b-ebb750760f70', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e33a46-ef18-45c2-b0d3-49690ad53a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e33a46-ef18-45c2-b0d3-49690ad53a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37afdf67-3a25-4a4b-ad0d-207401855922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Volume 0f806f82-d97f-4fd2-be6b-ebb750760f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f806f82-d97f-4fd2-be6b-ebb750760f70', 'volume_size': 1} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=07e8de3b-f57c-4f38-9143-3dc1abd74573,created_at=2026-09-03T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-672111385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07e8de3b-f57c-4f38-9143-3dc1abd74573,host='devstack@QuobyteHD#QuobyteHD',id=0f806f82-d97f-4fd2-be6b-ebb750760f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6a18c0e769446887735387ac90f64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:00:13Z,use_quota=True,user_id='7fd28a0a219442839d964bed26a442d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5a1e7da-8aa4-487a-a0a0-d7fca25cc54f),volume_type_id=c5a1e7da-8aa4-487a-a0a0-d7fca25cc54f)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Creating volume 0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:00:13 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:13 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 1073741824 Sep 03 11:00:13 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:13 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 1073741824" returned: 0 in 0.580s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:13 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 Sep 03 11:00:13 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:14 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70" returned: 0 in 0.300s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:00:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37afdf67-3a25-4a4b-ad0d-207401855922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f806f82-d97f-4fd2-be6b-ebb750760f70', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064cf572-0726-43be-b0fb-8ffe805ec484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:14 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Volume volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 (0f806f82-d97f-4fd2-be6b-ebb750760f70): created successfully Sep 03 11:00:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064cf572-0726-43be-b0fb-8ffe805ec484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Flow 'volume_create_manager' (120401c3-83a2-45fa-89e6-cdd8da292a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:00:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0074a0ae-8b71-447a-b1d8-7204511cec3b tempest-GroupsV314Test-1991986756 None] Created volume successfully. Sep 03 11:00:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:16 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Cloning volume 0f806f82-d97f-4fd2-be6b-ebb750760f70 to volume b6f58a95-c2f2-43b3-940f-b31692b1b3fe Sep 03 11:00:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Creating offline snapshot 4e0625d0-ab08-45db-9178-9d671499368e of volume 0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:00:16 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b56520c-4d9e-4213-9570-800b06db54ac]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:16 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 Sep 03 11:00:16 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:17 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70" returned: 0 in 0.641s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:17 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e 1G Sep 03 11:00:17 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:18 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e 1G" returned: 0 in 0.756s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:18 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e Sep 03 11:00:18 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:18 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e" returned: 0 in 0.700s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:18 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:00:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:18 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e Sep 03 11:00:18 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:19 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e" returned: 0 in 0.335s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:19 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.info Sep 03 11:00:19 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:19 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.info" returned: 0 in 0.416s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:19 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:00:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:19 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.info Sep 03 11:00:19 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:20 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.info" returned: 0 in 0.469s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Acquiring lock "cinder-quobyte-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Lock "cinder-quobyte-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] snapshot: 4e0625d0-ab08-45db-9178-9d671499368e, volume: b6f58a95-c2f2-43b3-940f-b31692b1b3fe, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c657b1-24dc-4248-952a-ff6a867745cb]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:20 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e Sep 03 11:00:20 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:20 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e" returned: 0 in 0.653s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f806f82-d97f-4fd2-be6b-ebb750760f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c4ef08-9e6b-4b9d-8873-344d0095de4f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:21 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 Sep 03 11:00:21 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:21 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70" returned: 0 in 0.682s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:00:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:00:21 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:00:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:21 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe Sep 03 11:00:21 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:00:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:23 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:00:23 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:24 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.813s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:24 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:00:24 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:00:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 28 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:00:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Flow 'volume_create_manager' (88a8b9b3-4302-445b-b65e-8c80f4710c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb9330d-e689-4a1f-9fb1-3a97be6c8b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb9330d-e689-4a1f-9fb1-3a97be6c8b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-671621771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0290089-7a3f-4a28-b15b-ad2e8b993677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97463220c75944098db72d55ff667283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:00:25Z,use_quota=True,user_id='0851acf8cc97442abbf498ed700f8fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356bcaf5-2574-4e2c-a4fb-c024d824f1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356bcaf5-2574-4e2c-a4fb-c024d824f1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b754e53-d1d1-43ee-8b04-921b159f1e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b754e53-d1d1-43ee-8b04-921b159f1e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0290089-7a3f-4a28-b15b-ad2e8b993677', 'volume_name': 'volume-c0290089-7a3f-4a28-b15b-ad2e8b993677', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6164cd0-4f57-4386-91a7-13fe76aae63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6164cd0-4f57-4386-91a7-13fe76aae63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe750bd2-d041-4940-8662-d0fc7d5aa716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:25 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Volume c0290089-7a3f-4a28-b15b-ad2e8b993677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0290089-7a3f-4a28-b15b-ad2e8b993677', 'volume_size': 1} Sep 03 11:00:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:29 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" returned: 0 in 7.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:00:29 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Converted 1024.00 MB image at 137.84 MB/s Sep 03 11:00:29 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:29 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe Sep 03 11:00:29 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:29 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" returned: 0 in 0.293s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Lock "cinder-quobyte-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" released by "_copy_volume_from_snapshot" :: held 9.177s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Acquiring lock "cinder-quobyte-4e0625d0-ab08-45db-9178-9d671499368e" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Lock "cinder-quobyte-4e0625d0-ab08-45db-9178-9d671499368e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Deleting offline snapshot 4e0625d0-ab08-45db-9178-9d671499368e of volume 0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] snapshot_file for this snap is: volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9296a7c8-e036-4828-9ff5-4d5e04b8cabc]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:29 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e Sep 03 11:00:29 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:29 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e" returned: 0 in 0.514s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f806f82-d97f-4fd2-be6b-ebb750760f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:00:30 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c5ec67-865e-4d41-bc2c-1f4105adc2a3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:30 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 Sep 03 11:00:30 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:30 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70" returned: 0 in 0.604s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:30 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e Sep 03 11:00:30 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:31 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e" returned: 0 in 0.451s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:31 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e Sep 03 11:00:31 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:31 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70.4e0625d0-ab08-45db-9178-9d671499368e" returned: 0 in 0.263s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Lock "cinder-quobyte-4e0625d0-ab08-45db-9178-9d671499368e" released by "_delete_snapshot" :: held 1.965s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.803s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.718s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-671621771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0290089-7a3f-4a28-b15b-ad2e8b993677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97463220c75944098db72d55ff667283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:00:25Z,use_quota=True,user_id='0851acf8cc97442abbf498ed700f8fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Creating volume c0290089-7a3f-4a28-b15b-ad2e8b993677 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:00:31 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:00:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:31 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 1073741824 Sep 03 11:00:31 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6ef44f2f-e0c1-4b2a-a5d8-073cf412be00 tempest-GroupsV314Test-1991986756 None] Create group from source-group-07e8de3b-f57c-4f38-9143-3dc1abd74573 completed successfully. Sep 03 11:00:32 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 1073741824" returned: 0 in 0.640s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:32 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 Sep 03 11:00:32 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:32 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677" returned: 0 in 0.417s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe750bd2-d041-4940-8662-d0fc7d5aa716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0290089-7a3f-4a28-b15b-ad2e8b993677', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e64b12-6702-4280-9f6d-bf9218e81ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Acquiring lock "cinder-quobyte-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:32 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Volume volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 (c0290089-7a3f-4a28-b15b-ad2e8b993677): created successfully Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e64b12-6702-4280-9f6d-bf9218e81ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Flow 'volume_create_manager' (88a8b9b3-4302-445b-b65e-8c80f4710c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Lock "cinder-quobyte-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" acquired by "delete_volume" :: waited 0.040s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e2e18254-21e1-4c7d-87e8-6b98da84334c tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Created volume successfully. Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c4aa51-519b-4d1e-85c7-60780d8ff633]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:32 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe Sep 03 11:00:32 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:33 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" returned: 0 in 0.376s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:33 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe Sep 03 11:00:33 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:33 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" returned: 0 in 0.304s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Lock "cinder-quobyte-b6f58a95-c2f2-43b3-940f-b31692b1b3fe" released by "delete_volume" :: held 0.737s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Created reservations ['609c216e-5f5d-44f6-bc2f-b4ff74b11ede'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:33 devstack cinder-volume[86603]: WARNING cinder.quota [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1199399873 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1199399873, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:00:33 devstack cinder-volume[86603]: WARNING cinder.quota [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1199399873 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1199399873, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Created reservations ['cd6429b1-2647-4c65-bdf8-4e1e4d94fdcf', 'fdfc920e-8ecd-4b9c-a362-b84f7be6d023', '47740dac-cc6d-4f57-9922-b73d83ce15d3', '1180e0b0-bbbf-4d9e-bf7c-a778f312b816'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:33 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:00:33 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Creating offline snapshot 2d01537c-85ee-46dc-9d05-4566f4f5a0a0 of volume c0290089-7a3f-4a28-b15b-ad2e8b993677 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6073be32-0d3f-4fd0-bee3-b5d4412ac6af]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:33 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.323s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:33 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:00:33 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 Sep 03 11:00:33 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:33 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c44eace5-5aac-462d-bc2b-07d74bbfdb72 tempest-GroupsV314Test-1991986756 None] Delete group completed successfully. Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=146,cinder:SELECT=127,cinder:INSERT=25,cinder:DELETE=6 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Acquiring lock "cinder-quobyte-0f806f82-d97f-4fd2-be6b-ebb750760f70" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Lock "cinder-quobyte-0f806f82-d97f-4fd2-be6b-ebb750760f70" acquired by "delete_volume" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a45249-ffad-4160-abca-cd8fb7b96a57]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:34 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677" returned: 0 in 0.474s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:34 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 Sep 03 11:00:34 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:34 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 1G Sep 03 11:00:34 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:34 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70" returned: 0 in 0.426s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:34 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70 Sep 03 11:00:34 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:34 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 1G" returned: 0 in 0.436s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:34 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 Sep 03 11:00:34 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:34 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0f806f82-d97f-4fd2-be6b-ebb750760f70" returned: 0 in 0.273s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Lock "cinder-quobyte-0f806f82-d97f-4fd2-be6b-ebb750760f70" released by "delete_volume" :: held 0.770s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=138,cinder:DELETE=5,cinder:SELECT=141,cinder:INSERT=36 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Created reservations ['6c4729bf-8211-4699-be05-3b87a066e0d3'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:34 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Created reservations ['d3fa0763-7272-4317-aec9-7bafb3a1ec51', 'f2995b91-6b41-4cfd-aa7b-b50cbc15a11c', '485414b9-cb84-4e95-b74c-ec44ed8ad95f', '629759b0-7509-43e5-b638-e79b2c295531'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:35 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0" returned: 0 in 0.322s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:35 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 is being set with open permissions: ugo+rw Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:35 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 Sep 03 11:00:35 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:35 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:00:35 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:35 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0" returned: 0 in 0.259s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:35 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.info Sep 03 11:00:35 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:35 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.273s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:00:35 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7c0753c4-a5c9-481f-a8e6-1916b1a2a9d3 tempest-GroupsV314Test-1991986756 None] Delete group completed successfully. Sep 03 11:00:35 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.info" returned: 0 in 0.349s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:35 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.info is being set with open permissions: ugo+rw Sep 03 11:00:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:35 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.info Sep 03 11:00:35 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:36 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.info" returned: 0 in 0.362s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ee303811-da20-4bcf-9cef-f75db7591695 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Create snapshot completed successfully Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Acquiring lock "cinder-2d01537c-85ee-46dc-9d05-4566f4f5a0a0-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-2d01537c-85ee-46dc-9d05-4566f4f5a0a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Acquiring lock "cinder-quobyte-c0290089-7a3f-4a28-b15b-ad2e8b993677" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-quobyte-c0290089-7a3f-4a28-b15b-ad2e8b993677" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Acquiring lock "cinder-quobyte-2d01537c-85ee-46dc-9d05-4566f4f5a0a0" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-quobyte-2d01537c-85ee-46dc-9d05-4566f4f5a0a0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Deleting offline snapshot 2d01537c-85ee-46dc-9d05-4566f4f5a0a0 of volume c0290089-7a3f-4a28-b15b-ad2e8b993677 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] snapshot_file for this snap is: volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a3548a-9f5d-484e-be07-509698be9088]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:37 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 Sep 03 11:00:37 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:37 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0" returned: 0 in 0.445s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0290089-7a3f-4a28-b15b-ad2e8b993677(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d66402-24f6-4b71-8d36-9097606da9c4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:38 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 Sep 03 11:00:38 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:38 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677" returned: 0 in 0.425s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:38 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 Sep 03 11:00:38 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:38 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0" returned: 0 in 0.483s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:38 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0 Sep 03 11:00:38 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:39 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677.2d01537c-85ee-46dc-9d05-4566f4f5a0a0" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-quobyte-2d01537c-85ee-46dc-9d05-4566f4f5a0a0" released by "_delete_snapshot" :: held 1.746s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-quobyte-c0290089-7a3f-4a28-b15b-ad2e8b993677" released by "delete_snapshot" :: held 1.771s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Created reservations ['3dafeeae-7e9b-46f1-84ce-eb37e782c4e1', '0a4aae47-e22b-489e-a9c4-553ffed358bc', 'd1a6d64c-273d-4ff1-977c-083d61bab806', 'aceac993-63c2-40d5-882f-4722e71e5d12'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Delete snapshot completed successfully. Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f735d938-d946-4c98-aebd-95eef4a5eb5f tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-2d01537c-85ee-46dc-9d05-4566f4f5a0a0-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Acquiring lock "cinder-c0290089-7a3f-4a28-b15b-ad2e8b993677-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-c0290089-7a3f-4a28-b15b-ad2e8b993677-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Acquiring lock "cinder-quobyte-c0290089-7a3f-4a28-b15b-ad2e8b993677" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-quobyte-c0290089-7a3f-4a28-b15b-ad2e8b993677" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f1ee35-9091-4257-9dbd-a7d5f48479ed]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:40 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 Sep 03 11:00:40 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:40 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677" returned: 0 in 0.495s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:40 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677 Sep 03 11:00:40 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:40 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c0290089-7a3f-4a28-b15b-ad2e8b993677" returned: 0 in 0.382s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-quobyte-c0290089-7a3f-4a28-b15b-ad2e8b993677" released by "delete_volume" :: held 0.964s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:40 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Created reservations ['cc2c3972-0e75-4dfd-acb6-19cf39030c5f', 'ef5bc0aa-1338-41f8-af60-5ab79fa0ca4e', 'd881941b-62f6-43c0-82ae-8e3dc7b81a13', '5edc7efc-977b-4671-9c24-7f64e7212ddb'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:41 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:00:41 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:41 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.330s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:41 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:00:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Deleted volume successfully. Sep 03 11:00:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c21ec8ca-0897-4af1-9999-7f1d80de8755 tempest-VolumeSnapshotQuotasNegativeTestJSON-683117253 None] Lock "cinder-c0290089-7a3f-4a28-b15b-ad2e8b993677-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ab73f63b-0113-4a6b-a2a8-a979f49a72e3 tempest-GroupsV320Test-2008716911 None] Group tempest-GroupsV320Test-Group-26955503: creating Sep 03 11:00:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ab73f63b-0113-4a6b-a2a8-a979f49a72e3 tempest-GroupsV320Test-2008716911 None] Group tempest-GroupsV320Test-Group-26955503: created successfully Sep 03 11:00:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ab73f63b-0113-4a6b-a2a8-a979f49a72e3 tempest-GroupsV320Test-2008716911 None] Create group completed successfully. Sep 03 11:00:44 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] Created reservations ['3a8e8183-e0de-4879-a846-8d94e9c3b900'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:00:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:44 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:00:44 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:44 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.453s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:44 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:00:44 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ae882584-3242-463b-a88f-4ff03f783333 tempest-GroupsV320Test-2008716911 None] Delete group completed successfully. Sep 03 11:00:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-5a4fae33-5cdb-4f4a-9ba4-dc2cdc59472e req-92f19b14-16eb-47dd-bdd9-49e17efd9626 tempest-AttachVolumeNegativeTest-1675740208 None] Terminate volume connection completed successfully. Sep 03 11:00:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-5a4fae33-5cdb-4f4a-9ba4-dc2cdc59472e req-92f19b14-16eb-47dd-bdd9-49e17efd9626 tempest-AttachVolumeNegativeTest-1675740208 None] Deleting attachment 90ffe7e6-e9af-4154-a9e1-7c1c8ba3080d. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:00:54 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=30,cinder:UPDATE=28,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Flow 'volume_create_manager' (5c1e8bd8-564d-4911-a23d-bb59b512358a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befa2d90-74e3-47b3-b305-0042019b3546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befa2d90-74e3-47b3-b305-0042019b3546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2096905275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68f5668-f87f-4293-bd86-d3a1e35a1c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6c05e50d9c49b5a80dbcb0016d63df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:00:55Z,use_quota=True,user_id='67ead5d88fa943858c6ad15bcee46ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0456438-fe4e-4d2c-a186-2475c4dac389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0456438-fe4e-4d2c-a186-2475c4dac389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b12600-6483-40d6-9750-b215a809d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b12600-6483-40d6-9750-b215a809d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd68f5668-f87f-4293-bd86-d3a1e35a1c2a', 'volume_name': 'volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088e8e73-f0f8-4ee0-a91b-a842f6562bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088e8e73-f0f8-4ee0-a91b-a842f6562bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279102b1-0ba5-4d58-b5d9-64dfe44276ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Volume d68f5668-f87f-4293-bd86-d3a1e35a1c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a', 'volume_size': 1} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2096905275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68f5668-f87f-4293-bd86-d3a1e35a1c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6c05e50d9c49b5a80dbcb0016d63df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:00:55Z,use_quota=True,user_id='67ead5d88fa943858c6ad15bcee46ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Creating volume d68f5668-f87f-4293-bd86-d3a1e35a1c2a {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:00:55 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:00:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:55 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a 1073741824 Sep 03 11:00:55 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:56 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a 1073741824" returned: 0 in 0.645s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:56 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a Sep 03 11:00:56 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:56 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a" returned: 0 in 0.382s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:00:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:00:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279102b1-0ba5-4d58-b5d9-64dfe44276ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9bd08ef-694c-409b-a50e-bfa69d63553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:00:56 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Volume volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a (d68f5668-f87f-4293-bd86-d3a1e35a1c2a): created successfully Sep 03 11:00:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9bd08ef-694c-409b-a50e-bfa69d63553d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:00:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Flow 'volume_create_manager' (5c1e8bd8-564d-4911-a23d-bb59b512358a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:00:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-50bfa327-ba98-44be-bd94-e94080086be4 tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Created volume successfully. Sep 03 11:00:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Acquiring lock "cinder-d68f5668-f87f-4293-bd86-d3a1e35a1c2a-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "cinder-d68f5668-f87f-4293-bd86-d3a1e35a1c2a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Acquiring lock "cinder-quobyte-d68f5668-f87f-4293-bd86-d3a1e35a1c2a" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:00:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "cinder-quobyte-d68f5668-f87f-4293-bd86-d3a1e35a1c2a" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:00:59 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2347add5-8b22-42b3-b0fa-a23d01ce1da4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:00:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:59 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a Sep 03 11:00:59 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:59 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a" returned: 0 in 0.445s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:00:59 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a Sep 03 11:00:59 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:00:59 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Sep 03 11:00:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d68f5668-f87f-4293-bd86-d3a1e35a1c2a" returned: 0 in 0.363s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:00:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "cinder-quobyte-d68f5668-f87f-4293-bd86-d3a1e35a1c2a" released by "delete_volume" :: held 0.873s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:00:59 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Created reservations ['703bd00f-9fc1-420a-8a7f-a24c508ef48a', '4f1fa6c0-c85d-4783-ab7b-48ab98ba10eb', '4df3fecc-0cdc-4639-892a-e9c3544bfb03', '185ff2cc-21ab-4b6d-afb5-ecdbcd28b401'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:00 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:00 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:00 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.458s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Deleted volume successfully. Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Flow 'volume_create_manager' (2df377a9-afe6-4886-8375-49e2b62a328c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653d9732-f57a-4884-888b-3096093140a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653d9732-f57a-4884-888b-3096093140a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1062928341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39df5e5e-1642-4a1c-8e81-d91453d60f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f9948ccfe5447cac64c93c5ef5a436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:00Z,use_quota=True,user_id='29ab39ca6cda4ac78498ba23d1768c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6296a3-1e7b-4c30-bd42-381ecc76ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6296a3-1e7b-4c30-bd42-381ecc76ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae41d49-0250-44e0-82ad-5d3500eacd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae41d49-0250-44e0-82ad-5d3500eacd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39df5e5e-1642-4a1c-8e81-d91453d60f2d', 'volume_name': 'volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed91bf1-e2d4-4421-b460-a8377945e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed91bf1-e2d4-4421-b460-a8377945e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7920b392-426e-4c17-94fe-b48203f4af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:00 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Volume 39df5e5e-1642-4a1c-8e81-d91453d60f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d', 'volume_size': 1} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1062928341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39df5e5e-1642-4a1c-8e81-d91453d60f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f9948ccfe5447cac64c93c5ef5a436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:00Z,use_quota=True,user_id='29ab39ca6cda4ac78498ba23d1768c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Creating volume 39df5e5e-1642-4a1c-8e81-d91453d60f2d {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:00 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea17ae67-6a5c-416e-925e-a1a5fad51d2b tempest-VolumeQuotasNegativeTestJSON-1736010099 None] Lock "cinder-d68f5668-f87f-4293-bd86-d3a1e35a1c2a-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:00 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d 1073741824 Sep 03 11:01:00 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:01 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d 1073741824" returned: 0 in 0.834s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:01 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d Sep 03 11:01:01 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:02 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d" returned: 0 in 0.368s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7920b392-426e-4c17-94fe-b48203f4af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbae758-a68f-455d-8456-2fb68ef81ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:02 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Volume volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d (39df5e5e-1642-4a1c-8e81-d91453d60f2d): created successfully Sep 03 11:01:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbae758-a68f-455d-8456-2fb68ef81ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Flow 'volume_create_manager' (2df377a9-afe6-4886-8375-49e2b62a328c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-451ce73f-5160-4d8a-a3ca-c0dfcc2dd51b tempest-VolumesTransfersV355Test-1734335092 None] Created volume successfully. Sep 03 11:01:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a008fc6f-eaa2-4326-939e-1a184a697748 tempest-VolumesTransfersV355Test-159920411 None] Transfer volume completed successfully. Sep 03 11:01:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Acquiring lock "cinder-39df5e5e-1642-4a1c-8e81-d91453d60f2d-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Lock "cinder-39df5e5e-1642-4a1c-8e81-d91453d60f2d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Acquiring lock "cinder-quobyte-39df5e5e-1642-4a1c-8e81-d91453d60f2d" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Lock "cinder-quobyte-39df5e5e-1642-4a1c-8e81-d91453d60f2d" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:05 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[af127a61-5851-4b0a-ac7d-4a009587fa96]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:05 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d Sep 03 11:01:05 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:05 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d" returned: 0 in 0.603s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:05 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d Sep 03 11:01:05 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:06 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-39df5e5e-1642-4a1c-8e81-d91453d60f2d" returned: 0 in 0.350s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Lock "cinder-quobyte-39df5e5e-1642-4a1c-8e81-d91453d60f2d" released by "delete_volume" :: held 1.037s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Created reservations ['6a701112-9dc2-4af1-b6c9-9116cb914093', '3c9acaf6-7340-4860-a1ae-39d75dcf2f49', 'd624be8a-583a-454c-a1f9-e6e9ac671742', 'e1d0b376-707d-4004-861b-ab48b3719aa5'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:06 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:06 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:06 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.348s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:06 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Deleted volume successfully. Sep 03 11:01:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d544332b-4d5c-4a6b-bf90-f446d01bb070 tempest-VolumesTransfersV355Test-396098295 None] Lock "cinder-39df5e5e-1642-4a1c-8e81-d91453d60f2d-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Flow 'volume_create_manager' (daac5cc7-8412-4cc9-840e-a723b5c93d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf92350e-5bc0-4d81-90a5-87ca4245d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf92350e-5bc0-4d81-90a5-87ca4245d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-723474251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3e4bfe-846c-48f2-855e-abe6cab852ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f9948ccfe5447cac64c93c5ef5a436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:08Z,use_quota=True,user_id='29ab39ca6cda4ac78498ba23d1768c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e52cb50-2f2b-4571-acf4-58797d617cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e52cb50-2f2b-4571-acf4-58797d617cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2a8c51-7f3a-4b76-b2fe-e4ec9475b34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2a8c51-7f3a-4b76-b2fe-e4ec9475b34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3e4bfe-846c-48f2-855e-abe6cab852ea', 'volume_name': 'volume-de3e4bfe-846c-48f2-855e-abe6cab852ea', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a917ea7-47a4-41cd-a73b-5dfb9f0eabd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a917ea7-47a4-41cd-a73b-5dfb9f0eabd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52cdafe1-71e9-4cde-8c4f-8eec4fe7a52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:08 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Volume de3e4bfe-846c-48f2-855e-abe6cab852ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3e4bfe-846c-48f2-855e-abe6cab852ea', 'volume_size': 1} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-723474251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3e4bfe-846c-48f2-855e-abe6cab852ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f9948ccfe5447cac64c93c5ef5a436',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:08Z,use_quota=True,user_id='29ab39ca6cda4ac78498ba23d1768c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Creating volume de3e4bfe-846c-48f2-855e-abe6cab852ea {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:08 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:08 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea 1073741824 Sep 03 11:01:08 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:09 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea 1073741824" returned: 0 in 1.107s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:09 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea Sep 03 11:01:09 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:10 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea" returned: 0 in 0.436s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52cdafe1-71e9-4cde-8c4f-8eec4fe7a52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3e4bfe-846c-48f2-855e-abe6cab852ea', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba6e5f1-a2a6-4dd9-b811-2f5dd254f497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:10 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Volume volume-de3e4bfe-846c-48f2-855e-abe6cab852ea (de3e4bfe-846c-48f2-855e-abe6cab852ea): created successfully Sep 03 11:01:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba6e5f1-a2a6-4dd9-b811-2f5dd254f497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Flow 'volume_create_manager' (daac5cc7-8412-4cc9-840e-a723b5c93d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0ba21a9c-b376-40d4-8f0f-1f16a916c1b7 tempest-VolumesTransfersV355Test-1734335092 None] Created volume successfully. Sep 03 11:01:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Acquiring lock "cinder-de3e4bfe-846c-48f2-855e-abe6cab852ea-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Lock "cinder-de3e4bfe-846c-48f2-855e-abe6cab852ea-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Acquiring lock "cinder-quobyte-de3e4bfe-846c-48f2-855e-abe6cab852ea" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Lock "cinder-quobyte-de3e4bfe-846c-48f2-855e-abe6cab852ea" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:11 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cc2f79-623e-42c2-b680-f355806c064a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:11 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea Sep 03 11:01:11 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:11 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea" returned: 0 in 0.534s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:12 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea Sep 03 11:01:12 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:12 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-de3e4bfe-846c-48f2-855e-abe6cab852ea" returned: 0 in 0.428s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Lock "cinder-quobyte-de3e4bfe-846c-48f2-855e-abe6cab852ea" released by "delete_volume" :: held 1.046s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:12 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Created reservations ['b3f467dc-ca56-4529-923a-9420ec9647f8', 'b93e9bf6-97c3-49d5-8156-0467a203867f', '005f93eb-410d-47d3-a88e-a4be29972f94', '7375c915-cd42-494c-9346-036550ce95b6'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:12 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:12 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:13 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.472s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:13 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Deleted volume successfully. Sep 03 11:01:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7f7b6ef3-a58c-4882-a9d3-e40a6c1a5172 tempest-VolumesTransfersV355Test-396098295 None] Lock "cinder-de3e4bfe-846c-48f2-855e-abe6cab852ea-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:22 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=46,cinder:INSERT=9,cinder:UPDATE=65,cinder:DELETE=3 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:23 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:23 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:23 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.418s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 28 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:01:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (7d57bff8-1dc6-4d95-839d-b853f624d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5c665c-b3c6-4ac6-981a-972cc4bfae75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5c665c-b3c6-4ac6-981a-972cc4bfae75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1850860495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c415b8-bc67-4e95-b336-09302d331d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:29Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c892e0-1640-47f7-9f71-f8b03e01b6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c892e0-1640-47f7-9f71-f8b03e01b6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ab083d-267b-4cb2-98c3-d227fa4f6e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ab083d-267b-4cb2-98c3-d227fa4f6e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c415b8-bc67-4e95-b336-09302d331d6f', 'volume_name': 'volume-a5c415b8-bc67-4e95-b336-09302d331d6f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5cf1ef-3bd9-46f9-b2dd-adfb617fc869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5cf1ef-3bd9-46f9-b2dd-adfb617fc869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b846c72a-d6b3-4676-aa6a-c9b7902a27fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:29 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Volume a5c415b8-bc67-4e95-b336-09302d331d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c415b8-bc67-4e95-b336-09302d331d6f', 'volume_size': 1} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1850860495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c415b8-bc67-4e95-b336-09302d331d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:29Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Creating volume a5c415b8-bc67-4e95-b336-09302d331d6f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:29 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:29 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f 1073741824 Sep 03 11:01:29 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:30 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f 1073741824" returned: 0 in 0.934s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:30 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f Sep 03 11:01:30 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Flow 'volume_create_manager' (686aed61-5c42-439e-bb2e-cb0ec2cccfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056a0e63-7f8f-438c-9055-d4aa17515ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:30 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056a0e63-7f8f-438c-9055-d4aa17515ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-273519425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7094fd-ce76-47dd-b209-bf6ac292bdc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df3f47b7ad5444194cd4af66c3ab234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:31Z,use_quota=True,user_id='d4aa6bdc343b4c85ba727fd06a72ac61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4cc83a-24ce-4a0c-b89a-699e0659c7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4cc83a-24ce-4a0c-b89a-699e0659c7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2983ce-006f-49dd-a9dd-5e5e218713c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2983ce-006f-49dd-a9dd-5e5e218713c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7094fd-ce76-47dd-b209-bf6ac292bdc2', 'volume_name': 'volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2cf8b0-349f-4b98-9124-6033a1307d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2cf8b0-349f-4b98-9124-6033a1307d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e62402-96d6-4f08-9311-acda51fde712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:30 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Volume 5e7094fd-ce76-47dd-b209-bf6ac292bdc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2', 'volume_size': 1} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f" returned: 0 in 0.599s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-273519425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7094fd-ce76-47dd-b209-bf6ac292bdc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df3f47b7ad5444194cd4af66c3ab234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:31Z,use_quota=True,user_id='d4aa6bdc343b4c85ba727fd06a72ac61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Creating volume 5e7094fd-ce76-47dd-b209-bf6ac292bdc2 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:30 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b846c72a-d6b3-4676-aa6a-c9b7902a27fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c415b8-bc67-4e95-b336-09302d331d6f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd7e177-7a29-4850-950f-9450c20c8425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:30 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 1073741824 Sep 03 11:01:30 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:30 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Volume volume-a5c415b8-bc67-4e95-b336-09302d331d6f (a5c415b8-bc67-4e95-b336-09302d331d6f): created successfully Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd7e177-7a29-4850-950f-9450c20c8425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (7d57bff8-1dc6-4d95-839d-b853f624d212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:30 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-36c36206-6656-4936-a07b-a8dc8b5b1ed0 tempest-VolumesActionsTest-2143280055 None] Created volume successfully. Sep 03 11:01:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8793d494-dc85-48bc-9f8a-f229ac5608ce tempest-VolumesActionsTest-2143280055 None] Acquiring lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f" by "attach_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8793d494-dc85-48bc-9f8a-f229ac5608ce tempest-VolumesActionsTest-2143280055 None] Lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f" acquired by "attach_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8793d494-dc85-48bc-9f8a-f229ac5608ce tempest-VolumesActionsTest-2143280055 None] Attaching volume a5c415b8-bc67-4e95-b336-09302d331d6f to instance 1c0ef431-984f-4dbc-a428-d7781777dc4a at mountpoint /dev/vdb on host None. Sep 03 11:01:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8793d494-dc85-48bc-9f8a-f229ac5608ce tempest-VolumesActionsTest-2143280055 None] Attach volume completed successfully. Sep 03 11:01:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8793d494-dc85-48bc-9f8a-f229ac5608ce tempest-VolumesActionsTest-2143280055 None] Lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f" released by "attach_volume" :: held 0.235s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:31 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 1073741824" returned: 0 in 0.869s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:31 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 Sep 03 11:01:31 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:32 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2" returned: 0 in 0.291s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e62402-96d6-4f08-9311-acda51fde712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53127ba-56a6-475a-a161-d8a1b8022806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:32 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Volume volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 (5e7094fd-ce76-47dd-b209-bf6ac292bdc2): created successfully Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53127ba-56a6-475a-a161-d8a1b8022806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Flow 'volume_create_manager' (686aed61-5c42-439e-bb2e-cb0ec2cccfd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-55393f6d-b3df-4e23-b9bb-49cf41fbc1ea tempest-VolumesTransfersV357Test-824437389 None] Created volume successfully. Sep 03 11:01:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-87c5c481-263d-43b4-b024-aec41141f8f9 tempest-VolumesActionsTest-1780590410 None] Terminate volume connection completed successfully. Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-87c5c481-263d-43b4-b024-aec41141f8f9 tempest-VolumesActionsTest-1780590410 None] Acquiring lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f-detach_volume" by "detach_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-87c5c481-263d-43b4-b024-aec41141f8f9 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-87c5c481-263d-43b4-b024-aec41141f8f9 tempest-VolumesActionsTest-1780590410 None] Detaching volume a5c415b8-bc67-4e95-b336-09302d331d6f from instance 1c0ef431-984f-4dbc-a428-d7781777dc4a. Sep 03 11:01:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-87c5c481-263d-43b4-b024-aec41141f8f9 tempest-VolumesActionsTest-1780590410 None] Detach volume completed successfully. Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-87c5c481-263d-43b4-b024-aec41141f8f9 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dab86882-3a4e-463a-9b7f-8a050e7ba2b1 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f-detach_volume" by "detach_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dab86882-3a4e-463a-9b7f-8a050e7ba2b1 tempest-VolumesActionsTest-2143280055 None] Lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-dab86882-3a4e-463a-9b7f-8a050e7ba2b1 tempest-VolumesActionsTest-2143280055 None] Volume detach called, but volume not attached. Sep 03 11:01:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dab86882-3a4e-463a-9b7f-8a050e7ba2b1 tempest-VolumesActionsTest-2143280055 None] Lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Acquiring lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Acquiring lock "cinder-quobyte-a5c415b8-bc67-4e95-b336-09302d331d6f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Lock "cinder-quobyte-a5c415b8-bc67-4e95-b336-09302d331d6f" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[568c9597-0081-414e-a24a-20d7006eec9c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Flow 'volume_create_manager' (82a12939-8056-4b53-b88c-4b9a073499d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209cea5c-1c22-4c60-8089-53330274520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209cea5c-1c22-4c60-8089-53330274520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-411860066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a202e33c-7128-4c42-8e22-d938094ba96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b983ec10e004caab4ad46f6576ae68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:33Z,use_quota=True,user_id='9b1aa21a1c6947b2aaf483f654e2efd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac05fe11-fae4-4781-91cf-feca61234bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac05fe11-fae4-4781-91cf-feca61234bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:33 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f Sep 03 11:01:33 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471edbc5-d658-4046-9b8b-bdfb90faa03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471edbc5-d658-4046-9b8b-bdfb90faa03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a202e33c-7128-4c42-8e22-d938094ba96a', 'volume_name': 'volume-a202e33c-7128-4c42-8e22-d938094ba96a', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ede9c1-1a8b-4d45-b467-1520fa111800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ede9c1-1a8b-4d45-b467-1520fa111800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfc86bc-ed30-4e09-b487-03993686c3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:33 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Volume a202e33c-7128-4c42-8e22-d938094ba96a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a202e33c-7128-4c42-8e22-d938094ba96a', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Trying to clone a202e33c-7128-4c42-8e22-d938094ba96a from image f9d13994-8b06-4b71-9618-b02e2701e179 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:01:33 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f" returned: 0 in 0.631s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:33 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f Sep 03 11:01:33 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:33 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1994a475-9be7-48ec-ba96-64b96bec9126 tempest-VolumesTransfersV357Test-1679111881 None] Transfer volume completed successfully. Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:01:34 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:01:34 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a5c415b8-bc67-4e95-b336-09302d331d6f" returned: 0 in 0.553s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Lock "cinder-quobyte-a5c415b8-bc67-4e95-b336-09302d331d6f" released by "delete_volume" :: held 1.271s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77bc510-d751-46c5-a549-c8aed9b23b36]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Created reservations ['5512966a-9f68-4469-a3ab-f222a60915ae', 'd6f8262c-45c5-4694-a45e-52251203fc78', '155f7c9e-e26f-4329-a879-e443853f85fc', 'ef145e94-641a-47ce-b4b3-0378f6e13a39'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:34 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD Sep 03 11:01:34 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:34 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:34 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:34 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 is fetched for user 9b1aa21a1c6947b2aaf483f654e2efd2. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:01:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Acquiring lock "cinder-5e7094fd-ce76-47dd-b209-bf6ac292bdc2-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Lock "cinder-5e7094fd-ce76-47dd-b209-bf6ac292bdc2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c709f5-541f-44cf-b4bd-a796c74669b6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:35 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Acquiring lock "cinder-quobyte-5e7094fd-ce76-47dd-b209-bf6ac292bdc2" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.344s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:35 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Deleted volume successfully. Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Lock "cinder-quobyte-5e7094fd-ce76-47dd-b209-bf6ac292bdc2" acquired by "delete_volume" :: waited 0.033s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e021aa3a-72d4-4c70-9418-ec9a984563da tempest-VolumesActionsTest-2143280055 None] Lock "cinder-a5c415b8-bc67-4e95-b336-09302d331d6f-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aeea1d-4f2d-45ce-8115-7f4dd3ab84e8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:35 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD Sep 03 11:01:35 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:35 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 Sep 03 11:01:35 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:35 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-411860066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a202e33c-7128-4c42-8e22-d938094ba96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b983ec10e004caab4ad46f6576ae68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:33Z,use_quota=True,user_id='9b1aa21a1c6947b2aaf483f654e2efd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Creating volume a202e33c-7128-4c42-8e22-d938094ba96a {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:35 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:35 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a 1073741824 Sep 03 11:01:35 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:35 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2" returned: 0 in 0.468s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:35 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2 Sep 03 11:01:35 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:35 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a 1073741824" returned: 0 in 0.570s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:35 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5e7094fd-ce76-47dd-b209-bf6ac292bdc2" returned: 0 in 0.361s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Lock "cinder-quobyte-5e7094fd-ce76-47dd-b209-bf6ac292bdc2" released by "delete_volume" :: held 0.896s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:36 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a Sep 03 11:01:36 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Created reservations ['8de77a78-141e-49b8-bb23-b0a9e15f07cc', 'f4c0f739-2c77-4259-9130-4b40c8bfb56e', 'a8b1cdeb-4ffd-49ee-aa54-2f3e34f71bfc', 'e968bcae-ab2f-4b16-9433-31d1b53cb74c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:36 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:36 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:36 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a" returned: 0 in 0.480s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Attempting download of f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume a202e33c-7128-4c42-8e22-d938094ba96a. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:01:36 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.386s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3507c8-446e-4a86-80fe-9e59d6736f98]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_bujmdnxf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Deleted volume successfully. Sep 03 11:01:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e69849c1-cca5-49e3-b516-7d430357732e tempest-VolumesTransfersV357Test-1089241541 None] Lock "cinder-5e7094fd-ce76-47dd-b209-bf6ac292bdc2-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:36 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_bujmdnxf Sep 03 11:01:36 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:37 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_bujmdnxf" returned: 0 in 0.576s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_bujmdnxf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:37 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_bujmdnxf Sep 03 11:01:37 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:37 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_bujmdnxf" returned: 1 in 0.502s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_bujmdnxf' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:01:37 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bc11a6-d2f9-4b08-86ee-1757a40aa7e9]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:37 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD Sep 03 11:01:37 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:38 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] f9d13994-8b06-4b71-9618-b02e2701e179 was qcow2, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:38 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a Sep 03 11:01:38 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Flow 'volume_create_manager' (b47f64ef-1c38-43dc-bb92-c87b1b8a3cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24fa4c1-234e-4678-aad6-8c623758065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24fa4c1-234e-4678-aad6-8c623758065f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-22618439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd5209f-a545-4788-9128-e157252b439a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a61289c99f4361ae0d3d4c5b0ba464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:38Z,use_quota=True,user_id='46519b3aef934be88060a93bf28345fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8cbaeb-8f03-49d5-aa7b-7cf6666346e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8cbaeb-8f03-49d5-aa7b-7cf6666346e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4a387a-cf96-4cfb-9840-9878c8fa56c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4a387a-cf96-4cfb-9840-9878c8fa56c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd5209f-a545-4788-9128-e157252b439a', 'volume_name': 'volume-fcd5209f-a545-4788-9128-e157252b439a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bc2127-a337-46f1-8ec1-03dec8dd7205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bc2127-a337-46f1-8ec1-03dec8dd7205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2a8704-dc9f-4738-ac91-98cd1d831dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Volume fcd5209f-a545-4788-9128-e157252b439a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd5209f-a545-4788-9128-e157252b439a', 'volume_size': 1} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-22618439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd5209f-a545-4788-9128-e157252b439a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a61289c99f4361ae0d3d4c5b0ba464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:38Z,use_quota=True,user_id='46519b3aef934be88060a93bf28345fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Creating volume fcd5209f-a545-4788-9128-e157252b439a {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:38 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:38 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a 1073741824 Sep 03 11:01:38 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Flow 'volume_create_manager' (46846e77-3623-4f0c-9e5d-cc79761270e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da2860f-db9e-45e1-add6-f3218ef96993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da2860f-db9e-45e1-add6-f3218ef96993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1205362226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6263ecdf-78ad-41ca-a924-5c8473a27b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df3f47b7ad5444194cd4af66c3ab234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:38Z,use_quota=True,user_id='d4aa6bdc343b4c85ba727fd06a72ac61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cb7e39-cfeb-4c04-8b26-c86bc0386a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cb7e39-cfeb-4c04-8b26-c86bc0386a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd442815-9b79-459e-9a90-cac380ecb034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd442815-9b79-459e-9a90-cac380ecb034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6263ecdf-78ad-41ca-a924-5c8473a27b04', 'volume_name': 'volume-6263ecdf-78ad-41ca-a924-5c8473a27b04', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f452ca98-adc0-445c-ac11-d61326fbadab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f452ca98-adc0-445c-ac11-d61326fbadab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a2314a-ea6d-4e63-8e9b-a588a915bde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:38 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Volume 6263ecdf-78ad-41ca-a924-5c8473a27b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6263ecdf-78ad-41ca-a924-5c8473a27b04', 'volume_size': 1} Sep 03 11:01:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:39 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a 1073741824" returned: 0 in 0.612s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:39 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a Sep 03 11:01:39 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (bfa95a3d-0b24-4cd9-b860-467addd0b3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95e6e90-2e8f-4aa4-947b-cf725b68bc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95e6e90-2e8f-4aa4-947b-cf725b68bc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-526422415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1880f94-4929-4277-b4e5-673e7a26e0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:39Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca847a6-a446-4594-8179-0193c0896458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca847a6-a446-4594-8179-0193c0896458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da91753-c084-4e06-a132-6fc2151de361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da91753-c084-4e06-a132-6fc2151de361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1880f94-4929-4277-b4e5-673e7a26e0a0', 'volume_name': 'volume-d1880f94-4929-4277-b4e5-673e7a26e0a0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bab9e1-6696-43fd-b717-36ef45e4546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bab9e1-6696-43fd-b717-36ef45e4546b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d11809-4145-4425-92cd-017930bf52da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:39 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Volume d1880f94-4929-4277-b4e5-673e7a26e0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1880f94-4929-4277-b4e5-673e7a26e0a0', 'volume_size': 1} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:39 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a" returned: 0 in 0.269s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1205362226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6263ecdf-78ad-41ca-a924-5c8473a27b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df3f47b7ad5444194cd4af66c3ab234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:38Z,use_quota=True,user_id='d4aa6bdc343b4c85ba727fd06a72ac61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Creating volume 6263ecdf-78ad-41ca-a924-5c8473a27b04 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:39 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2a8704-dc9f-4738-ac91-98cd1d831dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd5209f-a545-4788-9128-e157252b439a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b8abdd-a522-4e9e-a74b-a2355eef5a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:39 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 1073741824 Sep 03 11:01:39 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:39 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Volume volume-fcd5209f-a545-4788-9128-e157252b439a (fcd5209f-a545-4788-9128-e157252b439a): created successfully Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b8abdd-a522-4e9e-a74b-a2355eef5a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Flow 'volume_create_manager' (b47f64ef-1c38-43dc-bb92-c87b1b8a3cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-378fc8ea-9ccb-4ddb-b910-3deb99033091 tempest-AttachVolumeNegativeTest-1675740208 None] Created volume successfully. Sep 03 11:01:39 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 1073741824" returned: 0 in 0.480s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:39 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 Sep 03 11:01:39 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:40 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a" returned: 0 in 1.979s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_9t3vc1szdevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:01:40 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Converted 112.00 MB image at 56.54 MB/s Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:40 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a 1G Sep 03 11:01:40 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:40 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04" returned: 0 in 0.315s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.982s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-526422415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1880f94-4929-4277-b4e5-673e7a26e0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:39Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Creating volume d1880f94-4929-4277-b4e5-673e7a26e0a0 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:40 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a2314a-ea6d-4e63-8e9b-a588a915bde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6263ecdf-78ad-41ca-a924-5c8473a27b04', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:40 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 1073741824 Sep 03 11:01:40 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f7dd47-65da-4120-a3a6-774c8bd88ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:40 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Volume volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 (6263ecdf-78ad-41ca-a924-5c8473a27b04): created successfully Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f7dd47-65da-4120-a3a6-774c8bd88ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Flow 'volume_create_manager' (46846e77-3623-4f0c-9e5d-cc79761270e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-25ca7249-2156-40f4-824f-ad0ecde0e78a tempest-VolumesTransfersV357Test-824437389 None] Created volume successfully. Sep 03 11:01:40 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a 1G" returned: 0 in 0.366s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Downloaded image f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume a202e33c-7128-4c42-8e22-d938094ba96a successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 for user 9b1aa21a1c6947b2aaf483f654e2efd2 is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Marking volume a202e33c-7128-4c42-8e22-d938094ba96a as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Copying metadata from image f9d13994-8b06-4b71-9618-b02e2701e179 to a202e33c-7128-4c42-8e22-d938094ba96a. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Creating volume glance metadata for volume a202e33c-7128-4c42-8e22-d938094ba96a backed by image f9d13994-8b06-4b71-9618-b02e2701e179 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfc86bc-ed30-4e09-b487-03993686c3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a202e33c-7128-4c42-8e22-d938094ba96a', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967f2e87-16aa-4e26-b837-fc0662f5ae78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:40 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Volume volume-a202e33c-7128-4c42-8e22-d938094ba96a (a202e33c-7128-4c42-8e22-d938094ba96a): created successfully Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967f2e87-16aa-4e26-b837-fc0662f5ae78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Flow 'volume_create_manager' (82a12939-8056-4b53-b88c-4b9a073499d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-09b2b0aa-df6e-4be2-b135-8b01149461c9 tempest-VolumesImageMetadata-1030752442 None] Created volume successfully. Sep 03 11:01:40 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 1073741824" returned: 0 in 0.539s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:40 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 Sep 03 11:01:40 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:41 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0" returned: 0 in 0.279s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d11809-4145-4425-92cd-017930bf52da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1880f94-4929-4277-b4e5-673e7a26e0a0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f203bc3b-f044-49b2-acb0-ebc67de11092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-20e74741-9919-40e4-ae1d-c8a936601b2f req-7eca81a7-bd0a-409b-90bf-f7b6cd595923 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-20e74741-9919-40e4-ae1d-c8a936601b2f req-7eca81a7-bd0a-409b-90bf-f7b6cd595923 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-20e74741-9919-40e4-ae1d-c8a936601b2f req-7eca81a7-bd0a-409b-90bf-f7b6cd595923 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:41 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Volume volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 (d1880f94-4929-4277-b4e5-673e7a26e0a0): created successfully Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f203bc3b-f044-49b2-acb0-ebc67de11092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (bfa95a3d-0b24-4cd9-b860-467addd0b3a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-272e4951-761a-4f32-9507-ddc92b943fb4 tempest-VolumesActionsTest-2143280055 None] Created volume successfully. Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-20e74741-9919-40e4-ae1d-c8a936601b2f req-7eca81a7-bd0a-409b-90bf-f7b6cd595923 tempest-AttachVolumeNegativeTest-1675740208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-fcd5209f-a545-4788-9128-e157252b439a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4e4ec67-30ad-419a-9b28-219ad51b35bc', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:01:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-20e74741-9919-40e4-ae1d-c8a936601b2f req-7eca81a7-bd0a-409b-90bf-f7b6cd595923 tempest-AttachVolumeNegativeTest-1675740208 None] attachment_update completed successfully. Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Acquiring lock "cinder-6263ecdf-78ad-41ca-a924-5c8473a27b04-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Lock "cinder-6263ecdf-78ad-41ca-a924-5c8473a27b04-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Acquiring lock "cinder-quobyte-6263ecdf-78ad-41ca-a924-5c8473a27b04" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Lock "cinder-quobyte-6263ecdf-78ad-41ca-a924-5c8473a27b04" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Acquiring lock "cinder-a202e33c-7128-4c42-8e22-d938094ba96a-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d67d17-ae1a-4cfe-89b8-dcfe307c6b9c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Lock "cinder-a202e33c-7128-4c42-8e22-d938094ba96a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Acquiring lock "cinder-quobyte-a202e33c-7128-4c42-8e22-d938094ba96a" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Lock "cinder-quobyte-a202e33c-7128-4c42-8e22-d938094ba96a" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1448a11f-703d-454b-a18e-39029f2bc4cb]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:41 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 Sep 03 11:01:41 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:42 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a Sep 03 11:01:42 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:42 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04" returned: 0 in 0.482s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:42 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04 Sep 03 11:01:42 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:42 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a" returned: 0 in 0.470s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:42 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a Sep 03 11:01:42 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Acquiring lock "cinder-d1880f94-4929-4277-b4e5-673e7a26e0a0-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-d1880f94-4929-4277-b4e5-673e7a26e0a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:42 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6263ecdf-78ad-41ca-a924-5c8473a27b04" returned: 0 in 0.303s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Acquiring lock "cinder-quobyte-d1880f94-4929-4277-b4e5-673e7a26e0a0" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Lock "cinder-quobyte-6263ecdf-78ad-41ca-a924-5c8473a27b04" released by "delete_volume" :: held 0.869s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-quobyte-d1880f94-4929-4277-b4e5-673e7a26e0a0" acquired by "delete_volume" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b721956-6b94-4965-ad8b-f0c465b2652a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:42 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a202e33c-7128-4c42-8e22-d938094ba96a" returned: 0 in 0.330s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Created reservations ['7bdea254-337d-4f80-a825-52c4ddeb4a62', '162d833e-661f-4e9d-aba6-8ee1cdbdc753', 'e9c97d29-5530-444e-851b-2e416e2be10a', '8e35ea66-c894-41b5-a050-5330c585e089'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Lock "cinder-quobyte-a202e33c-7128-4c42-8e22-d938094ba96a" released by "delete_volume" :: held 0.873s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:42 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 Sep 03 11:01:42 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Created reservations ['58ddac61-d87b-4e5e-9f40-9f3be9dcb3f3', '6204a76f-d6b3-48a6-a002-e9878e384636', '97909cb1-81bf-4e62-b0a6-291bd9229de6', '34988e7b-3d27-47ee-844c-8cf5e366440b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:42 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:42 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:42 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:42 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:43 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.303s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Deleted volume successfully. Sep 03 11:01:43 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0" returned: 0 in 0.484s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a04d4c0-1d9d-4911-8e7b-75c8eee18a0c tempest-VolumesTransfersV357Test-1089241541 None] Lock "cinder-6263ecdf-78ad-41ca-a924-5c8473a27b04-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:43 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0 Sep 03 11:01:43 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:43 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.270s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Deleted volume successfully. Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-769c2654-7c25-4fc7-950f-65c59a2acb6d tempest-VolumesImageMetadata-1030752442 None] Lock "cinder-a202e33c-7128-4c42-8e22-d938094ba96a-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:43 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d1880f94-4929-4277-b4e5-673e7a26e0a0" returned: 0 in 0.274s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-quobyte-d1880f94-4929-4277-b4e5-673e7a26e0a0" released by "delete_volume" :: held 0.813s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Created reservations ['9abd8b8e-2c45-4a93-86cf-575537693095', '502e7758-ce60-4676-a1eb-6ad95f09ea8d', '847c2b3e-d965-4843-8502-fcf32026ac71', '541057a9-d581-4e7e-8d47-f0af1e8c5787'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:43 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:43 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:43 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Deleted volume successfully. Sep 03 11:01:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-143c7051-e70d-41f6-a7a1-9ad720d87785 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-d1880f94-4929-4277-b4e5-673e7a26e0a0-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:44 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-e6b3b9e0-3669-4909-ac38-722ba11ef627 req-473a549b-587f-4d2b-8be8-810139eb8f13 tempest-AttachVolumeNegativeTest-1675740208 None] Terminate volume connection completed successfully. Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-e6b3b9e0-3669-4909-ac38-722ba11ef627 req-473a549b-587f-4d2b-8be8-810139eb8f13 tempest-AttachVolumeNegativeTest-1675740208 None] Deleting attachment a4e4ec67-30ad-419a-9b28-219ad51b35bc. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (f088a35a-4c76-4d8d-8422-0730890ed3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9343c170-f79f-498d-b422-7f149d409ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9343c170-f79f-498d-b422-7f149d409ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1222537079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631cdda6-bde9-4105-ba45-fe0a5865a732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:44Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ace2f9b-ca62-4e6e-bb15-ab2a99616879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ace2f9b-ca62-4e6e-bb15-ab2a99616879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086d3f27-9c05-4bec-834a-370d63a43e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086d3f27-9c05-4bec-834a-370d63a43e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631cdda6-bde9-4105-ba45-fe0a5865a732', 'volume_name': 'volume-631cdda6-bde9-4105-ba45-fe0a5865a732', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2526f09-b4be-4d6f-b3b2-bca16468a90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2526f09-b4be-4d6f-b3b2-bca16468a90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1ad6f1-c32c-4124-be8e-fd58f7ebf513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Volume 631cdda6-bde9-4105-ba45-fe0a5865a732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631cdda6-bde9-4105-ba45-fe0a5865a732', 'volume_size': 1} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1222537079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631cdda6-bde9-4105-ba45-fe0a5865a732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:44Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Creating volume 631cdda6-bde9-4105-ba45-fe0a5865a732 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:44 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:44 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732 1073741824 Sep 03 11:01:44 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:45 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732 1073741824" returned: 0 in 0.608s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:45 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732 Sep 03 11:01:45 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:45 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732" returned: 0 in 0.348s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1ad6f1-c32c-4124-be8e-fd58f7ebf513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631cdda6-bde9-4105-ba45-fe0a5865a732', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065eb8eb-a8d5-403d-82fa-870a19f64e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:45 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Volume volume-631cdda6-bde9-4105-ba45-fe0a5865a732 (631cdda6-bde9-4105-ba45-fe0a5865a732): created successfully Sep 03 11:01:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065eb8eb-a8d5-403d-82fa-870a19f64e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (f088a35a-4c76-4d8d-8422-0730890ed3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:45 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c408daae-e705-4ec5-808a-42b283336219 tempest-VolumesActionsTest-2143280055 None] Created volume successfully. Sep 03 11:01:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Acquiring lock "cinder-631cdda6-bde9-4105-ba45-fe0a5865a732-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Lock "cinder-631cdda6-bde9-4105-ba45-fe0a5865a732-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Acquiring lock "cinder-quobyte-631cdda6-bde9-4105-ba45-fe0a5865a732" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Lock "cinder-quobyte-631cdda6-bde9-4105-ba45-fe0a5865a732" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:46 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55dd8b6-82d1-40e2-b90a-af70aa0c7d3a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:47 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732 Sep 03 11:01:47 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:47 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732" returned: 0 in 0.564s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:47 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732 Sep 03 11:01:47 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:47 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-631cdda6-bde9-4105-ba45-fe0a5865a732" returned: 0 in 0.340s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Lock "cinder-quobyte-631cdda6-bde9-4105-ba45-fe0a5865a732" released by "delete_volume" :: held 0.968s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:47 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Created reservations ['a404df53-5fd8-4745-a775-dafa83d94343', '2b765b29-0e51-4926-a12d-47b620d9ff0e', '93923d05-b716-4282-91a8-ed9ee6ff9ea0', 'a74efbde-96c6-41a9-8c70-7ed04aca506b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:48 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:48 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:48 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.302s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Deleted volume successfully. Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f795683b-8cfc-45d5-ae2c-c79378a664fa tempest-VolumesActionsTest-1780590410 None] Lock "cinder-631cdda6-bde9-4105-ba45-fe0a5865a732-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Flow 'volume_create_manager' (ea881980-ba2c-44eb-8d59-93d4e915d72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbafc96-85e0-4fd8-91b6-1948e703b106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbafc96-85e0-4fd8-91b6-1948e703b106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1773635064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc8bec1-e667-4281-94b7-7f3f097ccd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bb2c9a2dc4423592b91cdf92078da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:49Z,use_quota=True,user_id='d9a0ac17b0974f7d83e8e88febc90b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ee3063-35b3-4453-ba03-0af8f2303524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ee3063-35b3-4453-ba03-0af8f2303524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6524e224-8039-4a85-ba37-65d30773863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6524e224-8039-4a85-ba37-65d30773863a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc8bec1-e667-4281-94b7-7f3f097ccd87', 'volume_name': 'volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8ebc2d-8407-45ec-b2b9-989765b8b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8ebc2d-8407-45ec-b2b9-989765b8b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807ac63b-4b0f-4100-8cd8-3441a3788978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:48 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Volume 6fc8bec1-e667-4281-94b7-7f3f097ccd87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87', 'volume_size': 1} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1773635064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc8bec1-e667-4281-94b7-7f3f097ccd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65bb2c9a2dc4423592b91cdf92078da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:49Z,use_quota=True,user_id='d9a0ac17b0974f7d83e8e88febc90b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Creating volume 6fc8bec1-e667-4281-94b7-7f3f097ccd87 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:48 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:48 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 1073741824 Sep 03 11:01:48 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:49 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 1073741824" returned: 0 in 0.530s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:49 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 Sep 03 11:01:49 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:49 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (12fc4d1f-0003-4d90-9ace-ac7fa275fa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfcc22f-9606-424e-be6f-1547343dc511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfcc22f-9606-424e-be6f-1547343dc511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-622489908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de11ace-8686-4781-bda5-5fc482ddaf85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:50Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9021be-65b7-49b2-a390-3f2de58aa9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9021be-65b7-49b2-a390-3f2de58aa9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7184525f-bff8-4de3-9ed2-db7c4760c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7184525f-bff8-4de3-9ed2-db7c4760c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de11ace-8686-4781-bda5-5fc482ddaf85', 'volume_name': 'volume-3de11ace-8686-4781-bda5-5fc482ddaf85', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abd1e09-e537-4cc1-8e88-aede2b3e1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abd1e09-e537-4cc1-8e88-aede2b3e1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df60548-cbae-4d0b-aa07-c576a163f52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:49 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Volume 3de11ace-8686-4781-bda5-5fc482ddaf85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de11ace-8686-4781-bda5-5fc482ddaf85', 'volume_size': 1} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-622489908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de11ace-8686-4781-bda5-5fc482ddaf85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:50Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Creating volume 3de11ace-8686-4781-bda5-5fc482ddaf85 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:49 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807ac63b-4b0f-4100-8cd8-3441a3788978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafb500d-b8fd-4418-a1e8-b77a51d2a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:49 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85 1073741824 Sep 03 11:01:49 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:49 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Volume volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 (6fc8bec1-e667-4281-94b7-7f3f097ccd87): created successfully Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafb500d-b8fd-4418-a1e8-b77a51d2a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Flow 'volume_create_manager' (ea881980-ba2c-44eb-8d59-93d4e915d72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d25ba1d9-3638-4064-b3c1-d3c889b2b67d tempest-SnapshotMetadataTestJSON-1746682148 None] Created volume successfully. Sep 03 11:01:50 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85 1073741824" returned: 0 in 0.548s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:50 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85 Sep 03 11:01:50 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:50 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85" returned: 0 in 0.312s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df60548-cbae-4d0b-aa07-c576a163f52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de11ace-8686-4781-bda5-5fc482ddaf85', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0f4703-c03b-410a-91e2-d5f9aaf2897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:50 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Volume volume-3de11ace-8686-4781-bda5-5fc482ddaf85 (3de11ace-8686-4781-bda5-5fc482ddaf85): created successfully Sep 03 11:01:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0f4703-c03b-410a-91e2-d5f9aaf2897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (12fc4d1f-0003-4d90-9ace-ac7fa275fa2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:50 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4ae83c4e-db2b-42be-8ac3-85bb7e256482 tempest-VolumesActionsTest-2143280055 None] Created volume successfully. Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Creating offline snapshot 6ac5e484-430b-41c9-a283-b5f156994acd of volume 6fc8bec1-e667-4281-94b7-7f3f097ccd87 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea6161c-0f9d-425e-8041-86536c03c7d9]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:51 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 Sep 03 11:01:51 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:51 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:51 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd 1G Sep 03 11:01:51 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Flow 'volume_create_manager' (352b7fa0-f005-4771-816d-fb71ff11e9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183ff3ed-ef4e-4fd0-8d95-3e5ce457d5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183ff3ed-ef4e-4fd0-8d95-3e5ce457d5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-261359756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb353e9b-6a69-4e87-ba21-c08676f6eea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc79f006e3be4186b6d5f0eb4e04f8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:52Z,use_quota=True,user_id='811ebc3ca5b045339fcf615cbe48c65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed8bd9f-483e-4272-9fe3-9bf65830b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed8bd9f-483e-4272-9fe3-9bf65830b68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62ba29b-1f42-4ce8-841b-b173e0d86299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62ba29b-1f42-4ce8-841b-b173e0d86299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb353e9b-6a69-4e87-ba21-c08676f6eea2', 'volume_name': 'volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8aae0d0-a521-46a6-8ae3-0f4f36bedce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8aae0d0-a521-46a6-8ae3-0f4f36bedce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb86a79e-06b1-464c-9bc5-e164dbfd05ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:51 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Volume eb353e9b-6a69-4e87-ba21-c08676f6eea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2', 'volume_size': 1} Sep 03 11:01:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Acquiring lock "cinder-3de11ace-8686-4781-bda5-5fc482ddaf85-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Lock "cinder-3de11ace-8686-4781-bda5-5fc482ddaf85-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:52 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd 1G" returned: 0 in 0.569s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:52 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd Sep 03 11:01:52 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Acquiring lock "cinder-quobyte-3de11ace-8686-4781-bda5-5fc482ddaf85" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Lock "cinder-quobyte-3de11ace-8686-4781-bda5-5fc482ddaf85" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cff3bf0-42ab-4799-8d43-682e1519595d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:52 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85 Sep 03 11:01:52 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:52 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd" returned: 0 in 0.302s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:52 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd is being set with open permissions: ugo+rw Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:52 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd Sep 03 11:01:52 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:52 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85" returned: 0 in 0.428s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:52 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85 Sep 03 11:01:52 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:52 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd" returned: 0 in 0.270s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:52 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.info Sep 03 11:01:52 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:52 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3de11ace-8686-4781-bda5-5fc482ddaf85" returned: 0 in 0.291s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Lock "cinder-quobyte-3de11ace-8686-4781-bda5-5fc482ddaf85" released by "delete_volume" :: held 0.783s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Created reservations ['38607902-98da-4f5a-8a26-461d21ed369a', 'a512426c-4f3b-4acf-9d78-0f8cbf247213', '5bb02c22-a8bf-4dc7-8abf-7bf750d6be80', '53f33f3a-2d1f-41cc-aa6a-b604f9d6e016'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:53 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.info" returned: 0 in 0.282s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:53 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.info is being set with open permissions: ugo+rw Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:53 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.info Sep 03 11:01:53 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:53 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:53 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:53 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.info" returned: 0 in 0.296s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-261359756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb353e9b-6a69-4e87-ba21-c08676f6eea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc79f006e3be4186b6d5f0eb4e04f8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:52Z,use_quota=True,user_id='811ebc3ca5b045339fcf615cbe48c65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Creating volume eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:53 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:53 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 1073741824 Sep 03 11:01:53 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:53 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-620b8ee4-cfc3-469f-8b16-aa8505aac100 tempest-SnapshotMetadataTestJSON-1746682148 None] Create snapshot completed successfully Sep 03 11:01:53 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.321s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:53 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Deleted volume successfully. Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e6d8daee-aa71-49c1-94ef-7bb263a7969b tempest-VolumesActionsTest-1780590410 None] Lock "cinder-3de11ace-8686-4781-bda5-5fc482ddaf85-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (404a59e8-c96a-4321-b685-c0b783199c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7980dfad-3a0c-46fc-8629-b2e6c50b2761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7980dfad-3a0c-46fc-8629-b2e6c50b2761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1313457495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5371d5-e5d2-48fa-8022-bfa8b20cfc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:54Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:53 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b050d8ea-6270-4f91-ae0c-5883343ae4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b050d8ea-6270-4f91-ae0c-5883343ae4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef92afc-b6ac-4adb-8a8c-f22f76b29567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef92afc-b6ac-4adb-8a8c-f22f76b29567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a5371d5-e5d2-48fa-8022-bfa8b20cfc28', 'volume_name': 'volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ae3ade-aa73-4a0d-bd6c-fff6d36f5b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ae3ade-aa73-4a0d-bd6c-fff6d36f5b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6770f5c-4fa7-4119-abe7-a90dc34a059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:53 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Volume 1a5371d5-e5d2-48fa-8022-bfa8b20cfc28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28', 'volume_size': 1} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 1073741824" returned: 0 in 0.591s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:54 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 Sep 03 11:01:54 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:54 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2" returned: 0 in 0.281s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1313457495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5371d5-e5d2-48fa-8022-bfa8b20cfc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:54Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Creating volume 1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:01:54 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb86a79e-06b1-464c-9bc5-e164dbfd05ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:54 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 1073741824 Sep 03 11:01:54 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c722267-0cd3-42a7-94da-4d76ab26391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:54 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Volume volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 (eb353e9b-6a69-4e87-ba21-c08676f6eea2): created successfully Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c722267-0cd3-42a7-94da-4d76ab26391f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Flow 'volume_create_manager' (352b7fa0-f005-4771-816d-fb71ff11e9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:54 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0c3c2683-0d1e-46c5-8544-9234a1915797 tempest-VolumesCloneTest-205299109 None] Created volume successfully. Sep 03 11:01:54 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 1073741824" returned: 0 in 0.596s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:54 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 Sep 03 11:01:54 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Acquiring lock "cinder-6ac5e484-430b-41c9-a283-b5f156994acd-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-6ac5e484-430b-41c9-a283-b5f156994acd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Acquiring lock "cinder-quobyte-6fc8bec1-e667-4281-94b7-7f3f097ccd87" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-quobyte-6fc8bec1-e667-4281-94b7-7f3f097ccd87" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Acquiring lock "cinder-quobyte-6ac5e484-430b-41c9-a283-b5f156994acd" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-quobyte-6ac5e484-430b-41c9-a283-b5f156994acd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Deleting offline snapshot 6ac5e484-430b-41c9-a283-b5f156994acd of volume 6fc8bec1-e667-4281-94b7-7f3f097ccd87 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] snapshot_file for this snap is: volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99b232e-5d30-4f54-8f2f-93f2f8325fda]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:55 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28" returned: 0 in 0.406s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6770f5c-4fa7-4119-abe7-a90dc34a059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562cd130-12a7-4260-8dd5-17bea225289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Volume volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 (1a5371d5-e5d2-48fa-8022-bfa8b20cfc28): created successfully Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562cd130-12a7-4260-8dd5-17bea225289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (404a59e8-c96a-4321-b685-c0b783199c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5e8dcb4e-9360-429c-8bd9-165405f2c74d tempest-VolumesActionsTest-2143280055 None] Created volume successfully. Sep 03 11:01:55 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd Sep 03 11:01:55 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Flow 'volume_create_manager' (54661e12-ffee-43ce-bffc-45cc26eff8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31c4e96-4449-4092-8cde-3dd0d02c7f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31c4e96-4449-4092-8cde-3dd0d02c7f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1217608496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd42c93f-c046-4d31-bcf8-db3b8d4b79a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc79f006e3be4186b6d5f0eb4e04f8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=eb353e9b-6a69-4e87-ba21-c08676f6eea2,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:56Z,use_quota=True,user_id='811ebc3ca5b045339fcf615cbe48c65e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfa3e43-6e29-45e6-8317-e62362bf0601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfa3e43-6e29-45e6-8317-e62362bf0601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c2b0b3-57a9-4774-9f27-2fa6b9a01ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:56 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd" returned: 0 in 0.728s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c2b0b3-57a9-4774-9f27-2fa6b9a01ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bd42c93f-c046-4d31-bcf8-db3b8d4b79a2', 'volume_name': 'volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2', 'volume_size': 2, 'source_volid': 'eb353e9b-6a69-4e87-ba21-c08676f6eea2', 'source_volstatus': 'available'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24adac97-f594-4fdd-9fa9-8e0a92e3e255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24adac97-f594-4fdd-9fa9-8e0a92e3e255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d74910-85d8-445a-b02b-3b0500c131b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:56 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Volume bd42c93f-c046-4d31-bcf8-db3b8d4b79a2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2', 'volume_size': 2, 'source_volid': 'eb353e9b-6a69-4e87-ba21-c08676f6eea2', 'source_volstatus': 'available'} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3908d164-e4da-45ab-99e6-ac52ce35e7dc]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:56 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Cloning volume eb353e9b-6a69-4e87-ba21-c08676f6eea2 to volume bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Creating offline snapshot 8e77c99a-1d5f-453b-be2a-d7779d8c79d5 of volume eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[19235895-759d-4d26-9daf-ea7dc0536465]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Acquiring lock "cinder-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:56 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:56 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Acquiring lock "cinder-quobyte-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-quobyte-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b6b93e-7306-4a52-9c39-7550a78bfaf0]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:56 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 Sep 03 11:01:56 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:56 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 Sep 03 11:01:56 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:56 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87" returned: 0 in 0.588s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:56 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd Sep 03 11:01:56 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:56 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2" returned: 0 in 0.679s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:56 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 1G Sep 03 11:01:56 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:57 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28" returned: 0 in 0.714s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:57 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28 Sep 03 11:01:57 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:57 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd" returned: 0 in 0.527s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:57 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd Sep 03 11:01:57 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:57 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28" returned: 0 in 0.330s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:57 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-quobyte-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28" released by "delete_volume" :: held 1.103s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 1G" returned: 0 in 0.593s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:57 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:57 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87.6ac5e484-430b-41c9-a283-b5f156994acd" returned: 0 in 0.302s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:57 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-quobyte-6ac5e484-430b-41c9-a283-b5f156994acd" released by "_delete_snapshot" :: held 2.352s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-quobyte-6fc8bec1-e667-4281-94b7-7f3f097ccd87" released by "delete_snapshot" :: held 2.398s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Created reservations ['1aeef70e-9e9f-49c1-adf9-017b9f4e2a07', 'e1f8b0c8-2f5b-440c-8030-9b1a4135e3d4', 'e3f0a7f8-7170-44c5-8d36-523639a056d5', 'b269653f-2e70-46f8-9d3f-77bfacabe12f'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Created reservations ['0a7c2e72-d3ec-4b55-85cd-d1e82f22c8ea', '091923a8-39dd-4ab0-8f0a-4b02a49442c2', 'b7b970ee-64b5-43e6-b1ff-5e7d95bb62ac', '13d4a715-f53c-481b-9cc6-93f5b256c3bf'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:01:57 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:01:57 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Delete snapshot completed successfully. Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562d99fb-e492-4c07-9bf8-b81febacd8c2 tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-6ac5e484-430b-41c9-a283-b5f156994acd-delete_snapshot" released by "delete_snapshot" :: held 2.654s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:57 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5" returned: 0 in 0.407s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:57 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 is being set with open permissions: ugo+rw Sep 03 11:01:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:57 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 Sep 03 11:01:57 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:58 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.323s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:01:58 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Deleted volume successfully. Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2a1e4d51-e89f-46d1-9a10-fec6a14cc363 tempest-VolumesActionsTest-1780590410 None] Lock "cinder-1a5371d5-e5d2-48fa-8022-bfa8b20cfc28-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:58 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5" returned: 0 in 0.269s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:58 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.info Sep 03 11:01:58 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:58 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.info" returned: 0 in 0.306s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:58 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.info is being set with open permissions: ugo+rw Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Acquiring lock "cinder-6fc8bec1-e667-4281-94b7-7f3f097ccd87-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:58 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.info Sep 03 11:01:58 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-6fc8bec1-e667-4281-94b7-7f3f097ccd87-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Acquiring lock "cinder-quobyte-6fc8bec1-e667-4281-94b7-7f3f097ccd87" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-quobyte-6fc8bec1-e667-4281-94b7-7f3f097ccd87" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb70045-ba34-43c1-b329-6d0f928e72af]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:58 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.info" returned: 0 in 0.321s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:58 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 Sep 03 11:01:58 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Acquiring lock "cinder-quobyte-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Lock "cinder-quobyte-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] snapshot: 8e77c99a-1d5f-453b-be2a-d7779d8c79d5, volume: bd42c93f-c046-4d31-bcf8-db3b8d4b79a2, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[394a08fa-6b45-4017-9be7-e4e06a8b6a4a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:01:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:59 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 Sep 03 11:01:59 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:59 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87" returned: 0 in 0.672s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:01:59 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87 Sep 03 11:01:59 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (f810e039-973a-47cb-87a5-6bff2d1fa413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e631dd49-c557-4384-8efb-c62e103e63d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e631dd49-c557-4384-8efb-c62e103e63d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715607228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21a613b-4091-46ea-8e2b-1cb3622a3c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:59Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec141c90-b1da-48a1-925c-a9a98bf94969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec141c90-b1da-48a1-925c-a9a98bf94969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486ecdb4-6765-4ee9-a71c-9152cb1c4e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486ecdb4-6765-4ee9-a71c-9152cb1c4e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21a613b-4091-46ea-8e2b-1cb3622a3c00', 'volume_name': 'volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3328513a-7abf-487c-b112-4ff0ff632787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3328513a-7abf-487c-b112-4ff0ff632787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f189527b-95fa-4a0d-a3c6-1139b273ad77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:01:59 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Volume b21a613b-4091-46ea-8e2b-1cb3622a3c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00', 'volume_size': 1} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:01:59 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fc8bec1-e667-4281-94b7-7f3f097ccd87" returned: 0 in 0.549s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-quobyte-6fc8bec1-e667-4281-94b7-7f3f097ccd87" released by "delete_volume" :: held 1.306s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:01:59 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5" returned: 0 in 1.037s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:01:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e40c069-f578-45d0-a141-59a653a2f47a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Created reservations ['cec5718b-78f8-49f6-bcc1-e906537cd1d2', '62945832-879b-4ee2-ab14-e565c2ef2082', 'f41dce83-4daf-4056-9470-1eb7718ab574', 'f41164aa-9a75-46a6-99a7-13f70ea69843'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:00 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 Sep 03 11:02:00 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:00 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:00 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:00 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.450s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Deleted volume successfully. Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ae4066c-cafa-4a6f-8bba-85431605ed8d tempest-SnapshotMetadataTestJSON-1746682148 None] Lock "cinder-6fc8bec1-e667-4281-94b7-7f3f097ccd87-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:00 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2" returned: 0 in 0.731s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:02:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:00 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 Sep 03 11:02:00 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:08 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" returned: 0 in 7.919s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:08 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2, size 1024.00 MB, duration 7.92 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:02:08 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Converted 1024.00 MB image at 129.27 MB/s Sep 03 11:02:08 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 is being set with open permissions: ugo+rw Sep 03 11:02:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:08 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 Sep 03 11:02:08 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:09 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Lock "cinder-quobyte-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" released by "_copy_volume_from_snapshot" :: held 10.253s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Acquiring lock "cinder-quobyte-8e77c99a-1d5f-453b-be2a-d7779d8c79d5" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Lock "cinder-quobyte-8e77c99a-1d5f-453b-be2a-d7779d8c79d5" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Deleting offline snapshot 8e77c99a-1d5f-453b-be2a-d7779d8c79d5 of volume eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:02:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] snapshot_file for this snap is: volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:02:09 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8f4589-f9fa-4d6f-bd4e-6bda2f39e76e]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:09 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 Sep 03 11:02:09 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:10 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5" returned: 0 in 0.855s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:02:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a01d53c-c41e-4aec-a136-81cedc0b060f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:10 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 Sep 03 11:02:10 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:10 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2" returned: 0 in 0.531s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:10 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=103,cinder:UPDATE=121,cinder:DELETE=13,cinder:INSERT=40 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:02:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:10 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 Sep 03 11:02:10 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:11 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5" returned: 0 in 0.411s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:11 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5 Sep 03 11:02:11 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Flow 'volume_create_manager' (2698681a-d9f0-4ff2-8aa2-b0cf723b25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2e252a-136d-4ba7-8051-9602b03d62c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2e252a-136d-4ba7-8051-9602b03d62c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1951065421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759574e0-e217-4238-9327-026cd577aaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f57dea13e04d74abaff8854dae8e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:11Z,use_quota=True,user_id='a1233b2417b24e0c84bb22e1470a6dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fd738c-e10a-43f2-ad17-c1ddbd9876b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fd738c-e10a-43f2-ad17-c1ddbd9876b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7834d1-2f70-4af4-b526-04470ea91595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7834d1-2f70-4af4-b526-04470ea91595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759574e0-e217-4238-9327-026cd577aaba', 'volume_name': 'volume-759574e0-e217-4238-9327-026cd577aaba', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:11 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67633299-5d3f-4964-ba87-4756958ddfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67633299-5d3f-4964-ba87-4756958ddfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fbf5a6-1cd5-49e5-b3bc-31f04063b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:11 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Volume 759574e0-e217-4238-9327-026cd577aaba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759574e0-e217-4238-9327-026cd577aaba', 'volume_size': 1} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2.8e77c99a-1d5f-453b-be2a-d7779d8c79d5" returned: 0 in 0.313s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Lock "cinder-quobyte-8e77c99a-1d5f-453b-be2a-d7779d8c79d5" released by "_delete_snapshot" :: held 2.236s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.346s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.669s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715607228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21a613b-4091-46ea-8e2b-1cb3622a3c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8113612e1f8f4aa7b8f0f5a97f1250f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:01:59Z,use_quota=True,user_id='fe2f22ab423643b8a02e65dc310314ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Creating volume b21a613b-4091-46ea-8e2b-1cb3622a3c00 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:11 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d74910-85d8-445a-b02b-3b0500c131b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2', 'volume_size': 2, 'source_volid': 'eb353e9b-6a69-4e87-ba21-c08676f6eea2', 'source_volstatus': 'available'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:11 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 1073741824 Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88037d8f-775d-4af9-b521-a5ba6e55f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:11 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:11 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Volume volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 (bd42c93f-c046-4d31-bcf8-db3b8d4b79a2): created successfully Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88037d8f-775d-4af9-b521-a5ba6e55f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Flow 'volume_create_manager' (54661e12-ffee-43ce-bffc-45cc26eff8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-614a8b6f-3b96-4e44-9f35-5d355f163876 tempest-VolumesCloneTest-205299109 None] Created volume successfully. Sep 03 11:02:11 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 1073741824" returned: 0 in 0.428s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:11 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 Sep 03 11:02:11 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Acquiring lock "cinder-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:12 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Lock "cinder-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00" returned: 0 in 0.306s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.853s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1951065421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759574e0-e217-4238-9327-026cd577aaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f57dea13e04d74abaff8854dae8e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:11Z,use_quota=True,user_id='a1233b2417b24e0c84bb22e1470a6dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Creating volume 759574e0-e217-4238-9327-026cd577aaba {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:12 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:12 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba 1073741824 Sep 03 11:02:12 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f189527b-95fa-4a0d-a3c6-1139b273ad77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e942c558-20a1-4a79-b9be-8941aa22ea1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:12 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Volume volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 (b21a613b-4091-46ea-8e2b-1cb3622a3c00): created successfully Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e942c558-20a1-4a79-b9be-8941aa22ea1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Flow 'volume_create_manager' (f810e039-973a-47cb-87a5-6bff2d1fa413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:12 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-bb332de2-ba86-4ca0-ae15-886fd7b9194e tempest-VolumesActionsTest-2143280055 None] Created volume successfully. Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Acquiring lock "cinder-quobyte-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Lock "cinder-quobyte-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e7a08a-0f71-4839-a220-6a0d27d582f9]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:12 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 Sep 03 11:02:12 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:12 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba 1073741824" returned: 0 in 0.456s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:12 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba Sep 03 11:02:12 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:12 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" returned: 0 in 0.401s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:12 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2 Sep 03 11:02:12 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:13 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba" returned: 0 in 0.268s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fbf5a6-1cd5-49e5-b3bc-31f04063b62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759574e0-e217-4238-9327-026cd577aaba', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b571767-3773-4420-9219-b3dfcec9f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Volume volume-759574e0-e217-4238-9327-026cd577aaba (759574e0-e217-4238-9327-026cd577aaba): created successfully Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b571767-3773-4420-9219-b3dfcec9f2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:13 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Flow 'volume_create_manager' (2698681a-d9f0-4ff2-8aa2-b0cf723b25fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" returned: 0 in 0.281s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Lock "cinder-quobyte-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2" released by "delete_volume" :: held 0.720s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-95a4e0bb-5ac9-4941-90bd-9b5fb4539421 tempest-AbsoluteLimitsTests-1459888228 None] Created volume successfully. Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Created reservations ['1529d730-8680-4c26-80c1-508096907624', 'a51848e7-df78-4201-8f12-b18511a23e37', '47035232-3827-434b-ab8d-34da5d8be479', '7ba1868f-8a25-47bf-a2cc-078a4e735540'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:13 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:13 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Acquiring lock "cinder-eb353e9b-6a69-4e87-ba21-c08676f6eea2-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Lock "cinder-eb353e9b-6a69-4e87-ba21-c08676f6eea2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:13 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.345s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Deleted volume successfully. Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Acquiring lock "cinder-quobyte-eb353e9b-6a69-4e87-ba21-c08676f6eea2" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6b18cde5-10ac-43ca-b8d0-046dbf14632d tempest-VolumesCloneTest-205299109 None] Lock "cinder-bd42c93f-c046-4d31-bcf8-db3b8d4b79a2-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Lock "cinder-quobyte-eb353e9b-6a69-4e87-ba21-c08676f6eea2" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31c2a02-dcc6-4e89-8487-5d579423fe05]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Acquiring lock "cinder-759574e0-e217-4238-9327-026cd577aaba-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Lock "cinder-759574e0-e217-4238-9327-026cd577aaba-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Acquiring lock "cinder-quobyte-759574e0-e217-4238-9327-026cd577aaba" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:13 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Lock "cinder-quobyte-759574e0-e217-4238-9327-026cd577aaba" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:13 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd579a-e18b-4492-b3b1-f15c76012d1f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:14 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba Sep 03 11:02:14 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:14 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2" returned: 0 in 0.604s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:14 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2 Sep 03 11:02:14 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "cinder-b21a613b-4091-46ea-8e2b-1cb3622a3c00-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Lock "cinder-b21a613b-4091-46ea-8e2b-1cb3622a3c00-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "cinder-quobyte-b21a613b-4091-46ea-8e2b-1cb3622a3c00" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Lock "cinder-quobyte-b21a613b-4091-46ea-8e2b-1cb3622a3c00" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c003df-da17-442e-9aea-0b7aa044cca1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:14 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba" returned: 0 in 0.652s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:14 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba Sep 03 11:02:14 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:14 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eb353e9b-6a69-4e87-ba21-c08676f6eea2" returned: 0 in 0.355s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Lock "cinder-quobyte-eb353e9b-6a69-4e87-ba21-c08676f6eea2" released by "delete_volume" :: held 1.034s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:14 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 Sep 03 11:02:14 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Created reservations ['881852a8-504c-4277-9065-3210bd394b1f', '5e1620e8-e0d3-4732-9f1a-99eaac710cc4', '5bc91ddd-f63d-47c0-8306-a0d3da0fe8a2', '5d766665-1804-407a-8f55-aaf54be1ff2d'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:14 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:14 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:14 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-759574e0-e217-4238-9327-026cd577aaba" returned: 0 in 0.285s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Lock "cinder-quobyte-759574e0-e217-4238-9327-026cd577aaba" released by "delete_volume" :: held 1.002s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:14 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Created reservations ['7726d698-f08f-40db-991f-7766c68f1fce', '3103ddbe-c9dc-4cf1-bcf7-05882c3a7abd', '7ea7ff4b-0d81-49ef-ae05-a135660957fb', '42286ccd-fcfb-4d5e-b529-5e390f18b510'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:15 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00" returned: 0 in 0.431s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:15 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00 Sep 03 11:02:15 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:15 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:15 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:15 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.301s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Deleted volume successfully. Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7554b889-309a-4f59-9d3a-9051be25c020 tempest-VolumesCloneTest-205299109 None] Lock "cinder-eb353e9b-6a69-4e87-ba21-c08676f6eea2-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:15 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b21a613b-4091-46ea-8e2b-1cb3622a3c00" returned: 0 in 0.268s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Lock "cinder-quobyte-b21a613b-4091-46ea-8e2b-1cb3622a3c00" released by "delete_volume" :: held 0.733s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:15 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.265s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Deleted volume successfully. Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-174dc2c2-5a35-456d-9482-ddeb7942f213 tempest-AbsoluteLimitsTests-1459888228 None] Lock "cinder-759574e0-e217-4238-9327-026cd577aaba-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Created reservations ['91fcafca-a1a3-4438-a708-f5ac9a4d3853', 'd0b7b458-cdb4-4b3a-b7a6-85cac9ef6c68', 'dd68d6e9-520c-4fdd-b4b2-d474ece02487', 'ca8f39b4-02ca-4059-b01d-44c690c757a0'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:15 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:15 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:15 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.274s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Deleted volume successfully. Sep 03 11:02:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-65baceb9-e6bd-42a8-b39a-76d209b660f9 tempest-VolumesActionsTest-2143280055 None] Lock "cinder-b21a613b-4091-46ea-8e2b-1cb3622a3c00-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Flow 'volume_create_manager' (7423a2fe-92ba-413d-b6c1-a3ca0af866b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bcbf5d-e0ab-435d-98f3-e9750ecb2695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bcbf5d-e0ab-435d-98f3-e9750ecb2695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1339828439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03bfde107284179a23ec6f0f52361a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:20Z,use_quota=True,user_id='29ea81c1d5d34fc1b4434492670679a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d019a6-c072-4988-9917-02ff9cbb6585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d019a6-c072-4988-9917-02ff9cbb6585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783477b9-d02a-4d90-906f-7fafcb5f00e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783477b9-d02a-4d90-906f-7fafcb5f00e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec', 'volume_name': 'volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec', 'volume_size': 2}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3673ef-0386-47d5-b5de-02a4785fe3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3673ef-0386-47d5-b5de-02a4785fe3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52510029-6b85-424c-961a-38d33b96a4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:19 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Volume faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec', 'volume_size': 2} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1339828439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03bfde107284179a23ec6f0f52361a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:20Z,use_quota=True,user_id='29ea81c1d5d34fc1b4434492670679a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Creating volume faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:19 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec 2147483648 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:19 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec 2147483648 Sep 03 11:02:19 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:20 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec 2147483648" returned: 0 in 0.594s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:20 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec Sep 03 11:02:20 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:20 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec" returned: 0 in 0.320s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52510029-6b85-424c-961a-38d33b96a4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec', 'volume_size': 2}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df06916-c441-4ed2-947a-c1c25545911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:20 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Volume volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec (faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec): created successfully Sep 03 11:02:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df06916-c441-4ed2-947a-c1c25545911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Flow 'volume_create_manager' (7423a2fe-92ba-413d-b6c1-a3ca0af866b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:20 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-51fc5ee5-deb4-45d4-bbff-292f3fce717f tempest-VolumesCloneNegativeTest-1956623290 None] Created volume successfully. Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Flow 'volume_create_manager' (cbbf8d3a-7483-470a-854c-a8ed605cdbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b862fce-083e-4e69-9cff-b590f436c06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b862fce-083e-4e69-9cff-b590f436c06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1108523366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dc3bcf-9bdf-420b-b363-c7e04de17908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4277ce0b68f477abdd2dea6f8ddbf64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:21Z,use_quota=True,user_id='d52b2f18974a409298635df6bc447224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b310ed5-c574-4bf4-b861-4f75d12c4140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b310ed5-c574-4bf4-b861-4f75d12c4140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40db333-0da9-40f4-ae30-ede60c379058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40db333-0da9-40f4-ae30-ede60c379058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dc3bcf-9bdf-420b-b363-c7e04de17908', 'volume_name': 'volume-95dc3bcf-9bdf-420b-b363-c7e04de17908', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c1cf03-2514-4220-a415-2fd20a98ad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c1cf03-2514-4220-a415-2fd20a98ad8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28c7c33-ed03-4636-b1eb-2a96dca70654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:21 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Volume 95dc3bcf-9bdf-420b-b363-c7e04de17908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dc3bcf-9bdf-420b-b363-c7e04de17908', 'volume_size': 1} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1108523366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dc3bcf-9bdf-420b-b363-c7e04de17908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4277ce0b68f477abdd2dea6f8ddbf64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:21Z,use_quota=True,user_id='d52b2f18974a409298635df6bc447224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Creating volume 95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:21 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:21 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 1073741824 Sep 03 11:02:21 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:21 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 1073741824" returned: 0 in 0.551s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Acquiring lock "cinder-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:21 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 Sep 03 11:02:21 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Lock "cinder-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Acquiring lock "cinder-quobyte-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Lock "cinder-quobyte-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[36484df4-62df-49f8-aee7-d39bd2d43e86]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:22 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908" returned: 0 in 0.336s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:22 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec Sep 03 11:02:22 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28c7c33-ed03-4636-b1eb-2a96dca70654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dc3bcf-9bdf-420b-b363-c7e04de17908', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b7e1c7-517e-427e-bbc0-282c908c9ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:22 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Volume volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 (95dc3bcf-9bdf-420b-b363-c7e04de17908): created successfully Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b7e1c7-517e-427e-bbc0-282c908c9ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Flow 'volume_create_manager' (cbbf8d3a-7483-470a-854c-a8ed605cdbdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:22 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-537559a6-68d4-4152-9521-9fd2fa3a480c tempest-VolumesDeleteCascade-1711411148 None] Created volume successfully. Sep 03 11:02:22 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec" returned: 0 in 0.459s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:22 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec Sep 03 11:02:22 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:22 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec" returned: 0 in 0.260s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Lock "cinder-quobyte-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec" released by "delete_volume" :: held 0.799s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=132,cinder:INSERT=39,cinder:UPDATE=168,cinder:DELETE=14 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:02:22 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Created reservations ['e32d3d3c-42a3-4df9-a330-928b9af60ccb', '5f9a1370-15c0-4ad5-8cec-bd7cf821af89', '0b021a52-7303-4f84-8ab7-6b5ea98b629e', '39367fd4-755a-43ac-881f-fd954ad31254'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:23 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:23 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:23 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.377s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:23 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Deleted volume successfully. Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feecaeff-3e37-4ad8-b3af-e1e5e722bc36 tempest-VolumesCloneNegativeTest-1956623290 None] Lock "cinder-faa4468a-bdbc-4f21-b4fe-4bfa4d8636ec-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:23 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:23 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Creating offline snapshot 9ec57a0d-d0be-4acf-867d-78a2ca430910 of volume 95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d515a2-78e7-46f7-81e9-50b1aa4b00b6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:23 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.348s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 28 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:02:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:02:23 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 Sep 03 11:02:23 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:24 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908" returned: 0 in 0.417s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:24 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 1G Sep 03 11:02:24 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:24 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 1G" returned: 0 in 0.493s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:24 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 Sep 03 11:02:24 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:25 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910" returned: 0 in 0.409s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:25 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 is being set with open permissions: ugo+rw Sep 03 11:02:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:25 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 Sep 03 11:02:25 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:25 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910" returned: 0 in 0.293s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:25 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.info Sep 03 11:02:25 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:25 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.info" returned: 0 in 0.311s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:25 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.info is being set with open permissions: ugo+rw Sep 03 11:02:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:25 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.info Sep 03 11:02:25 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:26 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.info" returned: 0 in 0.309s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:26 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6cb43462-324d-4e9d-8096-d0360cb51861 tempest-VolumesDeleteCascade-1711411148 None] Create snapshot completed successfully Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Flow 'volume_create_manager' (fdadd9fb-55d3-4645-9cdd-d1b3ad7fc4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be40853b-af58-47f4-8003-a19dec83315b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be40853b-af58-47f4-8003-a19dec83315b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-368121762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff2c65d-538d-4979-b6d8-ffc6be0594a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b04c5291514985a99d2ae9eba1f67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:27Z,use_quota=True,user_id='569fc99decb14a759e06a1735329189a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38557633-de92-4eb6-ba9a-2344dc1b3b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38557633-de92-4eb6-ba9a-2344dc1b3b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e59631f-4318-479a-9766-83dfd104d70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e59631f-4318-479a-9766-83dfd104d70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff2c65d-538d-4979-b6d8-ffc6be0594a4', 'volume_name': 'volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21524ae-c506-47f4-a47b-a7ecca7d26de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21524ae-c506-47f4-a47b-a7ecca7d26de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27032aed-e088-48e2-9aa8-9d2b612cdaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:26 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Volume dff2c65d-538d-4979-b6d8-ffc6be0594a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4', 'volume_size': 1} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-368121762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff2c65d-538d-4979-b6d8-ffc6be0594a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b04c5291514985a99d2ae9eba1f67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:27Z,use_quota=True,user_id='569fc99decb14a759e06a1735329189a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Creating volume dff2c65d-538d-4979-b6d8-ffc6be0594a4 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:26 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:26 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 1073741824 Sep 03 11:02:26 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:27 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 1073741824" returned: 0 in 0.470s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:27 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 Sep 03 11:02:27 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:27 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4" returned: 0 in 0.292s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.554s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Creating offline snapshot adecc3a6-c5b2-4ec6-a377-fe7a05c932ef of volume 95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27032aed-e088-48e2-9aa8-9d2b612cdaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b509068-1db8-4b82-a98d-c5e1ee52f098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a89e28f-20c7-4dc1-a8eb-78eb8b89100a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:27 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Volume volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 (dff2c65d-538d-4979-b6d8-ffc6be0594a4): created successfully Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b509068-1db8-4b82-a98d-c5e1ee52f098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Flow 'volume_create_manager' (fdadd9fb-55d3-4645-9cdd-d1b3ad7fc4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:27 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-088e9f95-3cf4-40b0-a743-452c6f163390 tempest-VolumesNegativeTest-1931976656 None] Created volume successfully. Sep 03 11:02:27 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 Sep 03 11:02:27 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:28 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910" returned: 0 in 0.370s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:28 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dc3bcf-9bdf-420b-b363-c7e04de17908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:02:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:28 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef 1G Sep 03 11:02:28 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:28 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef 1G" returned: 0 in 0.426s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:28 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef Sep 03 11:02:28 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:28 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef" returned: 0 in 0.341s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:28 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef is being set with open permissions: ugo+rw Sep 03 11:02:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:28 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef Sep 03 11:02:28 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:29 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef" returned: 0 in 0.369s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.633s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:29 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4d60696a-48fb-436b-9fd7-35e9d0c8ca37 tempest-VolumesDeleteCascade-1711411148 None] Create snapshot completed successfully Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Flow 'volume_create_manager' (8ef3152f-a275-4bff-915b-8f7adec2baa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a559a8-6e5f-4590-b126-3f7b6cc79987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a559a8-6e5f-4590-b126-3f7b6cc79987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-803333933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b723b306-1555-4d91-9049-eb6e97ec1aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a61289c99f4361ae0d3d4c5b0ba464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:29Z,use_quota=True,user_id='46519b3aef934be88060a93bf28345fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fdfb61-96ab-47c6-8f02-d0c7259b482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fdfb61-96ab-47c6-8f02-d0c7259b482c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6eecb87-b533-4614-96a2-ef0b1af2108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6eecb87-b533-4614-96a2-ef0b1af2108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b723b306-1555-4d91-9049-eb6e97ec1aff', 'volume_name': 'volume-b723b306-1555-4d91-9049-eb6e97ec1aff', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0395f26-7c88-4833-9a9c-eecba86c8063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0395f26-7c88-4833-9a9c-eecba86c8063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fe6927-37cd-4066-a9d1-db14f6850f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:29 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Volume b723b306-1555-4d91-9049-eb6e97ec1aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b723b306-1555-4d91-9049-eb6e97ec1aff', 'volume_size': 1} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-803333933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b723b306-1555-4d91-9049-eb6e97ec1aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a61289c99f4361ae0d3d4c5b0ba464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:29Z,use_quota=True,user_id='46519b3aef934be88060a93bf28345fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Creating volume b723b306-1555-4d91-9049-eb6e97ec1aff {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:29 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:29 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff 1073741824 Sep 03 11:02:29 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:30 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff 1073741824" returned: 0 in 0.545s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:30 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff Sep 03 11:02:30 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-95dc3bcf-9bdf-420b-b363-c7e04de17908-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-95dc3bcf-9bdf-420b-b363-c7e04de17908-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Performing cascade delete. {{(pid=86603) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-9ec57a0d-d0be-4acf-867d-78a2ca430910-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-9ec57a0d-d0be-4acf-867d-78a2ca430910-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:30 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-95dc3bcf-9bdf-420b-b363-c7e04de17908" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff" returned: 0 in 0.329s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-95dc3bcf-9bdf-420b-b363-c7e04de17908" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-9ec57a0d-d0be-4acf-867d-78a2ca430910" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2fe6927-37cd-4066-a9d1-db14f6850f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b723b306-1555-4d91-9049-eb6e97ec1aff', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0eaf1e-0647-4d03-873c-b6d7026d5728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-9ec57a0d-d0be-4acf-867d-78a2ca430910" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Deleting offline snapshot 9ec57a0d-d0be-4acf-867d-78a2ca430910 of volume 95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] snapshot_file for this snap is: volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:02:30 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Volume volume-b723b306-1555-4d91-9049-eb6e97ec1aff (b723b306-1555-4d91-9049-eb6e97ec1aff): created successfully Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0eaf1e-0647-4d03-873c-b6d7026d5728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Flow 'volume_create_manager' (8ef3152f-a275-4bff-915b-8f7adec2baa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8325a04-aef2-4e1d-a044-1d1e19ff64b6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:30 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1dad6317-140d-4ddc-9148-527141e2d1ca tempest-AttachVolumeNegativeTest-1675740208 None] Created volume successfully. Sep 03 11:02:30 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 Sep 03 11:02:30 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:31 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910" returned: 0 in 0.540s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dc3bcf-9bdf-420b-b363-c7e04de17908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3cff46-d5f9-485c-a18c-88d921b42b18]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:31 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 Sep 03 11:02:31 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Flow 'volume_create_manager' (aeec76a6-2880-47bd-a804-09c2107e1ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fe61ff-303b-4ad3-a78e-d7717a44fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35fe61ff-303b-4ad3-a78e-d7717a44fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1116234150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10068d08-2cd2-4029-9625-8b2ceda8a645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063654e8ac44da79f561a985b8eb09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:31Z,use_quota=True,user_id='942cef3a41cd429cb85c4a3899247693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a2e4b1-cf58-44e5-9899-4cda59458697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a2e4b1-cf58-44e5-9899-4cda59458697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa72f751-c2aa-4e02-be24-aa3134e6fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa72f751-c2aa-4e02-be24-aa3134e6fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10068d08-2cd2-4029-9625-8b2ceda8a645', 'volume_name': 'volume-10068d08-2cd2-4029-9625-8b2ceda8a645', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6960ba64-f941-4199-9357-fc06dc71d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6960ba64-f941-4199-9357-fc06dc71d046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4759642-265f-4644-987f-cc129aba042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:31 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Volume 10068d08-2cd2-4029-9625-8b2ceda8a645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10068d08-2cd2-4029-9625-8b2ceda8a645', 'volume_size': 1} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1116234150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10068d08-2cd2-4029-9625-8b2ceda8a645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063654e8ac44da79f561a985b8eb09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:31Z,use_quota=True,user_id='942cef3a41cd429cb85c4a3899247693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Creating volume 10068d08-2cd2-4029-9625-8b2ceda8a645 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:31 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:31 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:31 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645 1073741824 Sep 03 11:02:31 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908" returned: 0 in 0.628s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f022bb-3025-47c2-a1cd-6dd2502c59e5]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:32 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef Sep 03 11:02:32 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:32 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645 1073741824" returned: 0 in 0.645s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:32 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef" returned: 0 in 0.463s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dc3bcf-9bdf-420b-b363-c7e04de17908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b339f11b-04a1-486f-ba95-a0ba295ee319]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:32 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645 Sep 03 11:02:32 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:32 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 Sep 03 11:02:32 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:32 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645" returned: 0 in 0.392s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4759642-265f-4644-987f-cc129aba042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10068d08-2cd2-4029-9625-8b2ceda8a645', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92aba224-00ef-44dc-9f4d-5a7071acab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:32 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Volume volume-10068d08-2cd2-4029-9625-8b2ceda8a645 (10068d08-2cd2-4029-9625-8b2ceda8a645): created successfully Sep 03 11:02:32 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92aba224-00ef-44dc-9f4d-5a7071acab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Flow 'volume_create_manager' (aeec76a6-2880-47bd-a804-09c2107e1ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910" returned: 0 in 0.520s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dc3bcf-9bdf-420b-b363-c7e04de17908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:02:33 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-51f59e46-9bab-47e8-976d-2a917e2b9ab4 tempest-VolumesTransfersTest-1433128462 None] Created volume successfully. Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaed2502-2875-42bb-8f96-dfdf535828a5]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:33 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 Sep 03 11:02:33 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-5112b1de-5340-4bc9-9e84-1b80efd54c66 req-93e639bd-baba-4725-9011-67a0602ba0eb tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-5112b1de-5340-4bc9-9e84-1b80efd54c66 req-93e639bd-baba-4725-9011-67a0602ba0eb tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-5112b1de-5340-4bc9-9e84-1b80efd54c66 req-93e639bd-baba-4725-9011-67a0602ba0eb tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-5112b1de-5340-4bc9-9e84-1b80efd54c66 req-93e639bd-baba-4725-9011-67a0602ba0eb tempest-AttachVolumeNegativeTest-1675740208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-b723b306-1555-4d91-9049-eb6e97ec1aff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1fc755d-dc0c-4579-b555-4c9dbbf1b42d', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:02:33 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-5112b1de-5340-4bc9-9e84-1b80efd54c66 req-93e639bd-baba-4725-9011-67a0602ba0eb tempest-AttachVolumeNegativeTest-1675740208 None] attachment_update completed successfully. Sep 03 11:02:33 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908" returned: 0 in 0.418s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:33 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 Sep 03 11:02:33 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:34 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910" returned: 0 in 0.546s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:34 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910 Sep 03 11:02:34 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:34 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.9ec57a0d-d0be-4acf-867d-78a2ca430910" returned: 0 in 0.309s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef -F qcow2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:34 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef -F qcow2 Sep 03 11:02:34 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:34 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c73cc1f9-2f89-4dbd-ba6d-97000a20a2ef tempest-VolumesTransfersTest-452248096 None] Transfer volume completed successfully. Sep 03 11:02:34 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef -F qcow2" returned: 0 in 0.512s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-9ec57a0d-d0be-4acf-867d-78a2ca430910" released by "_delete_snapshot" :: held 4.285s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-95dc3bcf-9bdf-420b-b363-c7e04de17908" released by "delete_snapshot" :: held 4.326s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:34 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Created reservations ['3260f1b2-165c-4947-8716-a651dc54d14f', 'cc2707bf-d8e4-48fa-aaa2-d3c50e189f94', '68a04dd0-1011-43cc-b1cc-e1963a457ceb', 'ceaa8367-1e4d-46b2-bcea-e13eced13678'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:35 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Delete snapshot completed successfully. Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-9ec57a0d-d0be-4acf-867d-78a2ca430910-delete_snapshot" released by "delete_snapshot" :: held 4.537s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-adecc3a6-c5b2-4ec6-a377-fe7a05c932ef-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-adecc3a6-c5b2-4ec6-a377-fe7a05c932ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-95dc3bcf-9bdf-420b-b363-c7e04de17908" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-95dc3bcf-9bdf-420b-b363-c7e04de17908" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-adecc3a6-c5b2-4ec6-a377-fe7a05c932ef" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Acquiring lock "cinder-10068d08-2cd2-4029-9625-8b2ceda8a645-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-adecc3a6-c5b2-4ec6-a377-fe7a05c932ef" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Deleting offline snapshot adecc3a6-c5b2-4ec6-a377-fe7a05c932ef of volume 95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] snapshot_file for this snap is: volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[95655975-4fda-417e-8b5c-a186597a8e45]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Lock "cinder-10068d08-2cd2-4029-9625-8b2ceda8a645-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Acquiring lock "cinder-quobyte-10068d08-2cd2-4029-9625-8b2ceda8a645" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Lock "cinder-quobyte-10068d08-2cd2-4029-9625-8b2ceda8a645" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46948e8-d31a-45e2-902f-7057bd6c5853]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:35 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef Sep 03 11:02:35 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:35 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645 Sep 03 11:02:35 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:36 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645" returned: 0 in 0.936s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:36 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645 Sep 03 11:02:36 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:36 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef" returned: 0 in 1.222s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95dc3bcf-9bdf-420b-b363-c7e04de17908(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:02:36 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[932fea37-82d3-4277-9be7-314eba94b6d4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:36 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 Sep 03 11:02:36 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:36 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-10068d08-2cd2-4029-9625-8b2ceda8a645" returned: 0 in 0.548s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Lock "cinder-quobyte-10068d08-2cd2-4029-9625-8b2ceda8a645" released by "delete_volume" :: held 1.609s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Created reservations ['6b9e3109-200c-4363-9b3e-24263319a7c6', '5cf7d6bc-f055-4dac-97f1-6f13c66022ce', '7fab2c27-e11c-4d08-82f9-a6946b9e8d5e', '5ec1199a-fd33-4c5a-a198-0a5c02e2b746'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-e65093ed-24c2-45f0-960f-b4af59754a52 req-30d1b2e7-b5f2-45d6-8e81-be858efa13ab tempest-AttachVolumeNegativeTest-1675740208 None] Terminate volume connection completed successfully. Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-e65093ed-24c2-45f0-960f-b4af59754a52 req-30d1b2e7-b5f2-45d6-8e81-be858efa13ab tempest-AttachVolumeNegativeTest-1675740208 None] Deleting attachment b1fc755d-dc0c-4579-b555-4c9dbbf1b42d. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:37 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908" returned: 0 in 0.877s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:37 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:37 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef Sep 03 11:02:37 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:37 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:38 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.799s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:38 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Deleted volume successfully. Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8a97fa4f-8d74-49b5-8c77-0e26b663fe9f tempest-VolumesTransfersTest-856556444 None] Lock "cinder-10068d08-2cd2-4029-9625-8b2ceda8a645-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:38 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef" returned: 0 in 0.903s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:38 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef Sep 03 11:02:38 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:38 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908.adecc3a6-c5b2-4ec6-a377-fe7a05c932ef" returned: 0 in 0.532s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-adecc3a6-c5b2-4ec6-a377-fe7a05c932ef" released by "_delete_snapshot" :: held 3.726s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Flow 'volume_create_manager' (6f445300-814b-4555-8e25-2364457d2bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc447cc-cdfc-4278-8c9f-b4f517c9f28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-95dc3bcf-9bdf-420b-b363-c7e04de17908" released by "delete_snapshot" :: held 3.805s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc447cc-cdfc-4278-8c9f-b4f517c9f28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-833179008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e30500-6dd9-400a-8d94-94b5f32be4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063654e8ac44da79f561a985b8eb09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:39Z,use_quota=True,user_id='942cef3a41cd429cb85c4a3899247693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99df45ed-a48a-4e7e-8a70-b8a8425df3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99df45ed-a48a-4e7e-8a70-b8a8425df3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bc573b-4254-48d8-bbaf-2102938b9f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bc573b-4254-48d8-bbaf-2102938b9f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e30500-6dd9-400a-8d94-94b5f32be4c2', 'volume_name': 'volume-57e30500-6dd9-400a-8d94-94b5f32be4c2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b93f4d-8d5e-45a1-b442-10a76c6df556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b93f4d-8d5e-45a1-b442-10a76c6df556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dd257c-d0df-4da4-be3f-154f61f0765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:39 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Volume 57e30500-6dd9-400a-8d94-94b5f32be4c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e30500-6dd9-400a-8d94-94b5f32be4c2', 'volume_size': 1} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-833179008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e30500-6dd9-400a-8d94-94b5f32be4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4063654e8ac44da79f561a985b8eb09d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:39Z,use_quota=True,user_id='942cef3a41cd429cb85c4a3899247693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Creating volume 57e30500-6dd9-400a-8d94-94b5f32be4c2 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:39 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:39 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 1073741824 Sep 03 11:02:39 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Created reservations ['64cfc0f1-3fee-44e5-b79c-8d6c2e0ae282', '227c912a-7b76-4a30-9398-d38d408fd4e9', 'eceeefae-dbe6-4787-8b9e-3531c34247a5', 'c41add62-ee2e-4b79-9d52-dcbd6d38768f'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Delete snapshot completed successfully. Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-adecc3a6-c5b2-4ec6-a377-fe7a05c932ef-delete_snapshot" released by "delete_snapshot" :: held 4.276s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Snapshots deleted, issuing volume delete {{(pid=86603) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-95dc3bcf-9bdf-420b-b363-c7e04de17908" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-95dc3bcf-9bdf-420b-b363-c7e04de17908" acquired by "delete_volume" :: waited 0.072s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1586fb-7e6a-43cf-bc36-e2dd6d24a653]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:39 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 Sep 03 11:02:39 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:40 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 1073741824" returned: 0 in 1.282s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:40 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908" returned: 0 in 0.686s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:40 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908 Sep 03 11:02:40 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:40 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 Sep 03 11:02:40 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:40 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2" returned: 0 in 0.412s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6dd257c-d0df-4da4-be3f-154f61f0765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e30500-6dd9-400a-8d94-94b5f32be4c2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e00be39-3c5f-40e8-aae5-c3186fccd7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:40 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Volume volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 (57e30500-6dd9-400a-8d94-94b5f32be4c2): created successfully Sep 03 11:02:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e00be39-3c5f-40e8-aae5-c3186fccd7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Flow 'volume_create_manager' (6f445300-814b-4555-8e25-2364457d2bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:41 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-95dc3bcf-9bdf-420b-b363-c7e04de17908" returned: 0 in 0.580s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9b6ebd90-6540-4263-9468-21c7b12979b0 tempest-VolumesTransfersTest-1433128462 None] Created volume successfully. Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-95dc3bcf-9bdf-420b-b363-c7e04de17908" released by "delete_volume" :: held 1.617s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Created reservations ['84ad9fb9-0877-41d7-8cdb-90bc71499a78', '4623c6fb-aa30-46ea-9a3f-6e602f1a2006', '9281acf3-aad3-4f0c-aef3-36a4c82561a2', '1a1068cf-6724-41e6-8ad9-1236905d6cd2'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:41 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:41 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:41 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.316s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Deleted volume successfully. Sep 03 11:02:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e2d09e4-ada2-47f0-8e8e-e64cb211c66a tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-95dc3bcf-9bdf-420b-b363-c7e04de17908-delete_volume" released by "delete_volume" :: held 11.197s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Acquiring lock "cinder-57e30500-6dd9-400a-8d94-94b5f32be4c2-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Lock "cinder-57e30500-6dd9-400a-8d94-94b5f32be4c2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Acquiring lock "cinder-quobyte-57e30500-6dd9-400a-8d94-94b5f32be4c2" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Lock "cinder-quobyte-57e30500-6dd9-400a-8d94-94b5f32be4c2" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[870fd408-32a3-4d28-b881-c244d569043a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:42 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 Sep 03 11:02:42 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Flow 'volume_create_manager' (f9cbb408-e215-4f05-8154-241aa1ac74f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacd7e4d-976e-4d80-b1f4-059ec0e930bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacd7e4d-976e-4d80-b1f4-059ec0e930bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-412440385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699314b6-514e-4cdc-bd03-2ed4c493f177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4277ce0b68f477abdd2dea6f8ddbf64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:43Z,use_quota=True,user_id='d52b2f18974a409298635df6bc447224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f0456-664a-4a48-9bb6-e7eecc4f1a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f0456-664a-4a48-9bb6-e7eecc4f1a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576faadf-8634-41ec-ad48-d1d33ddd2778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576faadf-8634-41ec-ad48-d1d33ddd2778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699314b6-514e-4cdc-bd03-2ed4c493f177', 'volume_name': 'volume-699314b6-514e-4cdc-bd03-2ed4c493f177', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8faa55c-c2d3-4210-81f9-0d3723abe6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8faa55c-c2d3-4210-81f9-0d3723abe6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577454a4-a4b1-4160-9f06-e5f3e1a16597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:42 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Volume 699314b6-514e-4cdc-bd03-2ed4c493f177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699314b6-514e-4cdc-bd03-2ed4c493f177', 'volume_size': 1} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-412440385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699314b6-514e-4cdc-bd03-2ed4c493f177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4277ce0b68f477abdd2dea6f8ddbf64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:43Z,use_quota=True,user_id='d52b2f18974a409298635df6bc447224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Creating volume 699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:42 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:43 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 1073741824 Sep 03 11:02:43 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:43 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2" returned: 0 in 0.437s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:43 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2 Sep 03 11:02:43 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:43 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-57e30500-6dd9-400a-8d94-94b5f32be4c2" returned: 0 in 0.288s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Lock "cinder-quobyte-57e30500-6dd9-400a-8d94-94b5f32be4c2" released by "delete_volume" :: held 0.790s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Created reservations ['84e08035-1d27-4400-957c-60539a6b9a64', '120257f3-4714-4fb0-b0a4-393cbb803fa9', 'da943881-d8d7-4402-b698-4218f994d226', '8c5bba87-d7ef-42db-b854-d730db1c1210'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:43 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 1073741824" returned: 0 in 0.574s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:43 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:43 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:43 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 Sep 03 11:02:43 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:44 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.436s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:44 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Deleted volume successfully. Sep 03 11:02:44 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177" returned: 0 in 0.440s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577454a4-a4b1-4160-9f06-e5f3e1a16597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699314b6-514e-4cdc-bd03-2ed4c493f177', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3ad56d-d9bc-4d7b-93f2-7b238cd87c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-edfa2949-917a-48f4-bdbb-a8c0ab47ae48 tempest-VolumesTransfersTest-856556444 None] Lock "cinder-57e30500-6dd9-400a-8d94-94b5f32be4c2-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Volume volume-699314b6-514e-4cdc-bd03-2ed4c493f177 (699314b6-514e-4cdc-bd03-2ed4c493f177): created successfully Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3ad56d-d9bc-4d7b-93f2-7b238cd87c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Flow 'volume_create_manager' (f9cbb408-e215-4f05-8154-241aa1ac74f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:44 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ad95aff0-9c56-45a4-8952-0a8ac9c46670 tempest-VolumesDeleteCascade-1711411148 None] Created volume successfully. Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "cinder-b723b306-1555-4d91-9049-eb6e97ec1aff-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-b723b306-1555-4d91-9049-eb6e97ec1aff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "cinder-quobyte-b723b306-1555-4d91-9049-eb6e97ec1aff" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-quobyte-b723b306-1555-4d91-9049-eb6e97ec1aff" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f374272e-3191-4f9e-a6cd-4ed924bf041c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:44 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff Sep 03 11:02:44 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Creating offline snapshot 84caca12-a43e-46b4-8835-ae7dafbda15a of volume 699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:02:45 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff" returned: 0 in 0.485s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4df0b9-a23d-4c53-bda5-c367e8da24c4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:45 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff Sep 03 11:02:45 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:45 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 Sep 03 11:02:45 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b723b306-1555-4d91-9049-eb6e97ec1aff" returned: 0 in 0.382s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:45 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-quobyte-b723b306-1555-4d91-9049-eb6e97ec1aff" released by "delete_volume" :: held 0.931s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Created reservations ['1a756c29-dcae-4881-9c62-4674aacdd55a', '5e6d6b84-34fc-42e7-96ad-42e8db04ecfb', '5cccf7c4-e618-4892-ab34-7e226ea9a59a', '57cc744d-8db7-4989-a076-a5bcda4d6b23'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:45 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177" returned: 0 in 0.554s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:45 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a 1G Sep 03 11:02:45 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:45 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:45 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:46 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.292s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:46 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:46 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Deleted volume successfully. Sep 03 11:02:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9193edf6-1875-4eb7-b4c3-676ee7a21ae2 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-b723b306-1555-4d91-9049-eb6e97ec1aff-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:46 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a 1G" returned: 0 in 0.520s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-699314b6-514e-4cdc-bd03-2ed4c493f177 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:46 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-699314b6-514e-4cdc-bd03-2ed4c493f177 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a Sep 03 11:02:46 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:46 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-699314b6-514e-4cdc-bd03-2ed4c493f177 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a" returned: 0 in 0.361s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:46 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a is being set with open permissions: ugo+rw Sep 03 11:02:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:46 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a Sep 03 11:02:46 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:47 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a" returned: 0 in 0.358s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "cinder-fcd5209f-a545-4788-9128-e157252b439a-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-fcd5209f-a545-4788-9128-e157252b439a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:47 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.info Sep 03 11:02:47 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "cinder-quobyte-fcd5209f-a545-4788-9128-e157252b439a" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-quobyte-fcd5209f-a545-4788-9128-e157252b439a" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410e447-bf6e-4503-8803-8a4cdb490c07]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:47 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a Sep 03 11:02:47 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:47 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.info" returned: 0 in 0.394s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:47 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.info is being set with open permissions: ugo+rw Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:47 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.info Sep 03 11:02:47 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:47 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a" returned: 0 in 0.490s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:47 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a Sep 03 11:02:47 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:47 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.info" returned: 0 in 0.339s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-966664c5-a27d-4f85-92b9-ed5a065b7215 tempest-VolumesDeleteCascade-1711411148 None] Create snapshot completed successfully Sep 03 11:02:48 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fcd5209f-a545-4788-9128-e157252b439a" returned: 0 in 0.306s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-quobyte-fcd5209f-a545-4788-9128-e157252b439a" released by "delete_volume" :: held 0.864s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Created reservations ['b5c9e30f-7d90-4d7d-96aa-90cbbd4f5735', 'd2df73b2-f343-437a-bb60-75afb5bb0bff', 'ae6f548d-f9dc-4b69-ab80-4a6e9f451b6a', '7bf16baa-9ce2-48d6-88ca-1fd60dc4127b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:48 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:48 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:48 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.324s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Deleted volume successfully. Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-154772ea-2763-4f8e-a307-6b3590212a98 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-fcd5209f-a545-4788-9128-e157252b439a-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "cinder-20a5497a-88f1-41d2-b415-07bcf1a9873e-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-20a5497a-88f1-41d2-b415-07bcf1a9873e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "cinder-quobyte-20a5497a-88f1-41d2-b415-07bcf1a9873e" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-quobyte-20a5497a-88f1-41d2-b415-07bcf1a9873e" acquired by "delete_volume" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67c6b5d-1e2b-4607-9a69-96d0af012b87]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:49 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e Sep 03 11:02:49 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Flow 'volume_create_manager' (d7dfa0e9-3a5b-4020-87d6-66e86ed436fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5b02da-3328-4ed0-860f-d69e14f492a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5b02da-3328-4ed0-860f-d69e14f492a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1534239589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eeafd78-691a-4db7-828c-7e031feccd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4277ce0b68f477abdd2dea6f8ddbf64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=84caca12-a43e-46b4-8835-ae7dafbda15a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:49Z,use_quota=True,user_id='d52b2f18974a409298635df6bc447224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:49 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d139b400-0b59-4d6b-ac46-87cf455184ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d139b400-0b59-4d6b-ac46-87cf455184ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d58bed4-cb4f-487b-b753-8d5297565530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d58bed4-cb4f-487b-b753-8d5297565530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0eeafd78-691a-4db7-828c-7e031feccd32', 'volume_name': 'volume-0eeafd78-691a-4db7-828c-7e031feccd32', 'volume_size': 1, 'snapshot_id': '84caca12-a43e-46b4-8835-ae7dafbda15a'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e162a74-8f7e-4682-a44c-b1d1975aa32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e162a74-8f7e-4682-a44c-b1d1975aa32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08fb82d-3a1b-4c71-8f51-52f587c2bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:49 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Volume 0eeafd78-691a-4db7-828c-7e031feccd32: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0eeafd78-691a-4db7-828c-7e031feccd32', 'volume_size': 1, 'snapshot_id': '84caca12-a43e-46b4-8835-ae7dafbda15a'} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e" returned: 0 in 0.548s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-84caca12-a43e-46b4-8835-ae7dafbda15a-0eeafd78-691a-4db7-828c-7e031feccd32" by "_create_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-84caca12-a43e-46b4-8835-ae7dafbda15a-0eeafd78-691a-4db7-828c-7e031feccd32" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Creating volume 0eeafd78-691a-4db7-828c-7e031feccd32 from snapshot 84caca12-a43e-46b4-8835-ae7dafbda15a {{(pid=86603) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:49 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e Sep 03 11:02:49 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-0eeafd78-691a-4db7-828c-7e031feccd32" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-0eeafd78-691a-4db7-828c-7e031feccd32" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] snapshot: 84caca12-a43e-46b4-8835-ae7dafbda15a, volume: 0eeafd78-691a-4db7-828c-7e031feccd32, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[08049395-081e-467f-9a3d-69ec2604a7fa]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:49 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a Sep 03 11:02:49 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:49 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-20a5497a-88f1-41d2-b415-07bcf1a9873e" returned: 0 in 0.336s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-quobyte-20a5497a-88f1-41d2-b415-07bcf1a9873e" released by "delete_volume" :: held 0.952s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Created reservations ['8dd21c59-3bf0-4fca-a4f0-ba0445a366b6', 'a05fb28d-069b-45b6-9601-33cb335d4710', '656e8fab-094f-48f3-b3d6-19d6c10ad574', 'a86dd758-1b9a-44ef-94bd-d3afbde35a75'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:50 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:50 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:50 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a" returned: 0 in 0.545s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-699314b6-514e-4cdc-bd03-2ed4c493f177(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ec90b-a4dc-4133-8bbe-7f4fbccb56e7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:50 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 Sep 03 11:02:50 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:50 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.413s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:50 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Deleted volume successfully. Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7c56b582-a402-487f-b7f0-24e49a256343 tempest-AttachVolumeNegativeTest-1675740208 None] Lock "cinder-20a5497a-88f1-41d2-b415-07bcf1a9873e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:50 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177" returned: 0 in 0.502s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:02:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:50 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 Sep 03 11:02:50 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Acquiring lock "cinder-dff2c65d-538d-4979-b6d8-ffc6be0594a4-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Lock "cinder-dff2c65d-538d-4979-b6d8-ffc6be0594a4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Acquiring lock "cinder-quobyte-dff2c65d-538d-4979-b6d8-ffc6be0594a4" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Lock "cinder-quobyte-dff2c65d-538d-4979-b6d8-ffc6be0594a4" acquired by "delete_volume" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:53 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3ab9db-b36f-4911-88b9-b8cc1a5e45c6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:53 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 Sep 03 11:02:53 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:54 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4" returned: 0 in 0.988s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:54 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4 Sep 03 11:02:54 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:55 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dff2c65d-538d-4979-b6d8-ffc6be0594a4" returned: 0 in 0.503s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Lock "cinder-quobyte-dff2c65d-538d-4979-b6d8-ffc6be0594a4" released by "delete_volume" :: held 1.631s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:55 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Created reservations ['7e4a50b1-02b3-4c75-8146-dae9e6257d0c', 'f3f183b4-df60-495c-a630-712bea625534', '93fdd32e-0b6b-45d4-a97f-6bb156c14b9e', '0f0a04ee-7cc1-488c-a3da-ab84aa28f5c8'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:02:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:55 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:02:55 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:56 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.716s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:56 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:02:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Deleted volume successfully. Sep 03 11:02:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e019cd7c-f25e-46b7-8265-428a79fd88ca tempest-VolumesNegativeTest-1931976656 None] Lock "cinder-dff2c65d-538d-4979-b6d8-ffc6be0594a4-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:56 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32" returned: 0 in 6.297s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:56 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:02:56 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Converted 1024.00 MB image at 162.59 MB/s Sep 03 11:02:57 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 is being set with open permissions: ugo+rw Sep 03 11:02:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:57 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 Sep 03 11:02:57 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:57 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32" returned: 0 in 0.410s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-0eeafd78-691a-4db7-828c-7e031feccd32" released by "_copy_volume_from_snapshot" :: held 7.881s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-84caca12-a43e-46b4-8835-ae7dafbda15a-0eeafd78-691a-4db7-828c-7e031feccd32" released by "_create_volume_from_snapshot" :: held 7.978s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:02:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08fb82d-3a1b-4c71-8f51-52f587c2bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eeafd78-691a-4db7-828c-7e031feccd32', 'volume_size': 1, 'snapshot_id': '84caca12-a43e-46b4-8835-ae7dafbda15a'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ca612c-b09e-4fe5-9f8f-18a2d1fa17ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:57 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Volume volume-0eeafd78-691a-4db7-828c-7e031feccd32 (0eeafd78-691a-4db7-828c-7e031feccd32): created successfully Sep 03 11:02:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ca612c-b09e-4fe5-9f8f-18a2d1fa17ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Flow 'volume_create_manager' (d7dfa0e9-3a5b-4020-87d6-66e86ed436fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8b1ff943-15cd-40b5-a46c-613b20b144b9 tempest-VolumesDeleteCascade-1711411148 None] Created volume successfully. Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Flow 'volume_create_manager' (2200dc09-7d7b-4cb5-a1e4-a2bfe42c7e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b54bbe1-5df7-44c5-8dc3-ec669b9998b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b54bbe1-5df7-44c5-8dc3-ec669b9998b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-76740428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28e5602-d187-4c15-99f4-65d0d1f24d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545e952ad57b49a084fbf6e2914fd176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:58Z,use_quota=True,user_id='e9b8d665c2cf48a9bc93ffea36803973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963d5809-5d97-45d3-adbb-0dd06d6788cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963d5809-5d97-45d3-adbb-0dd06d6788cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624707cd-78a2-4237-abf6-e66ccaa9f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624707cd-78a2-4237-abf6-e66ccaa9f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28e5602-d187-4c15-99f4-65d0d1f24d21', 'volume_name': 'volume-d28e5602-d187-4c15-99f4-65d0d1f24d21', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73789a3-89f6-4845-8cb2-02e82cd8dbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73789a3-89f6-4845-8cb2-02e82cd8dbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc73ab6-1e44-4241-98c2-03a88757e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:58 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Volume d28e5602-d187-4c15-99f4-65d0d1f24d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28e5602-d187-4c15-99f4-65d0d1f24d21', 'volume_size': 1} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-76740428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28e5602-d187-4c15-99f4-65d0d1f24d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='545e952ad57b49a084fbf6e2914fd176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:02:58Z,use_quota=True,user_id='e9b8d665c2cf48a9bc93ffea36803973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Creating volume d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:02:58 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:58 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 1073741824 Sep 03 11:02:58 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-699314b6-514e-4cdc-bd03-2ed4c493f177-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-699314b6-514e-4cdc-bd03-2ed4c493f177-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Performing cascade delete. {{(pid=86603) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-84caca12-a43e-46b4-8835-ae7dafbda15a-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-84caca12-a43e-46b4-8835-ae7dafbda15a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-699314b6-514e-4cdc-bd03-2ed4c493f177" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-699314b6-514e-4cdc-bd03-2ed4c493f177" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-84caca12-a43e-46b4-8835-ae7dafbda15a" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-84caca12-a43e-46b4-8835-ae7dafbda15a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Deleting offline snapshot 84caca12-a43e-46b4-8835-ae7dafbda15a of volume 699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] snapshot_file for this snap is: volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c6e28-9200-44a3-b6b1-490b21da3047]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:59 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 1073741824" returned: 0 in 0.616s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:59 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a Sep 03 11:02:59 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:59 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 Sep 03 11:02:59 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:02:59 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21" returned: 0 in 0.297s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc73ab6-1e44-4241-98c2-03a88757e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28e5602-d187-4c15-99f4-65d0d1f24d21', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da4fbe8-cbea-4b2d-8532-cc107a03ed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:02:59 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Volume volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 (d28e5602-d187-4c15-99f4-65d0d1f24d21): created successfully Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da4fbe8-cbea-4b2d-8532-cc107a03ed4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Flow 'volume_create_manager' (2200dc09-7d7b-4cb5-a1e4-a2bfe42c7e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:02:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f276aace-3d09-43ee-a53e-9bb1386329d2 tempest-VolumesSnapshotListTestJSON-2102176012 None] Created volume successfully. Sep 03 11:02:59 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a" returned: 0 in 0.533s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-699314b6-514e-4cdc-bd03-2ed4c493f177(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab44461-0c2c-4561-adda-20980eb700a6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:02:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:02:59 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 Sep 03 11:02:59 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:00 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177" returned: 0 in 0.650s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:00 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a Sep 03 11:03:00 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:00 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a" returned: 0 in 0.485s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:00 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a Sep 03 11:03:00 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Creating offline snapshot 0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 of volume d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:00 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2ffcb2-c2fb-4f17-a309-0fb700cb5c6f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:01 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 Sep 03 11:03:01 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:01 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177.84caca12-a43e-46b4-8835-ae7dafbda15a" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-84caca12-a43e-46b4-8835-ae7dafbda15a" released by "_delete_snapshot" :: held 2.229s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-699314b6-514e-4cdc-bd03-2ed4c493f177" released by "delete_snapshot" :: held 2.264s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Created reservations ['50324550-da47-47d9-a094-a5046fa83d8a', '0290b7ec-d1a7-4e38-913b-8e627c738f3d', 'd033919d-88bd-442a-a23d-81ffb508540f', '01e87db0-c1a2-4bf0-ac8e-b82da6e154fe'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Delete snapshot completed successfully. Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-84caca12-a43e-46b4-8835-ae7dafbda15a-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Snapshots deleted, issuing volume delete {{(pid=86603) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-699314b6-514e-4cdc-bd03-2ed4c493f177" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-699314b6-514e-4cdc-bd03-2ed4c493f177" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:01 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21" returned: 0 in 0.559s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb683f-611d-4edf-b19f-b9d88115228f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:01 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 1G Sep 03 11:03:01 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:01 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 Sep 03 11:03:01 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:01 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177" returned: 0 in 0.471s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:01 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177 Sep 03 11:03:01 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:01 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 1G" returned: 0 in 0.552s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:01 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 Sep 03 11:03:01 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:02 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-699314b6-514e-4cdc-bd03-2ed4c493f177" returned: 0 in 0.324s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-699314b6-514e-4cdc-bd03-2ed4c493f177" released by "delete_volume" :: held 0.893s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Created reservations ['610f863f-a3ba-485c-871e-f09e99130b39', 'f6f7232e-d883-41ce-b86b-5e0705eda243', '66c2c6c3-1595-4864-a07d-bc8cf95d10a8', '7b46d7f4-daae-4516-a400-988bdfcd466a'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:02 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" returned: 0 in 0.478s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:02 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 is being set with open permissions: ugo+rw Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:02 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:02 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:02 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 Sep 03 11:03:02 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:02 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" returned: 0 in 0.308s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:02 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.340s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Deleted volume successfully. Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-66207999-5213-4100-8077-ad21ab10038e tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-699314b6-514e-4cdc-bd03-2ed4c493f177-delete_volume" released by "delete_volume" :: held 4.052s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:02 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.info Sep 03 11:03:02 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:03 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.info" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:03 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.info is being set with open permissions: ugo+rw Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:03 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.info Sep 03 11:03:03 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:03 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-0eeafd78-691a-4db7-828c-7e031feccd32-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.info" returned: 0 in 0.323s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-0eeafd78-691a-4db7-828c-7e031feccd32-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-49d8d87b-1d25-4f87-be20-70d6495ac990 tempest-VolumesSnapshotListTestJSON-2102176012 None] Create snapshot completed successfully Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "cinder-quobyte-0eeafd78-691a-4db7-828c-7e031feccd32" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-0eeafd78-691a-4db7-828c-7e031feccd32" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46457ba-3ddc-43e1-96d1-9228c98b97b7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:03 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 Sep 03 11:03:03 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Flow 'volume_create_manager' (de73ad8f-16be-4abe-a17c-a1145abf255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d576ecf1-d672-4990-9a5d-346d1a3148d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d576ecf1-d672-4990-9a5d-346d1a3148d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-846588624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a64cea4-0b79-4d12-86e9-aa55817d9355,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bfb0dfe9f8d440498b6bbe7c19f4829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:04Z,use_quota=True,user_id='9082df2f72e14b38962e98b902882f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e4eb5f-6810-48ce-b2ba-e18c3e3b2898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e4eb5f-6810-48ce-b2ba-e18c3e3b2898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42d74a6-fc94-44e8-b964-edfa41b4fe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42d74a6-fc94-44e8-b964-edfa41b4fe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a64cea4-0b79-4d12-86e9-aa55817d9355', 'volume_name': 'volume-9a64cea4-0b79-4d12-86e9-aa55817d9355', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5257dfa-3f3b-4006-bea7-9d67acca828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5257dfa-3f3b-4006-bea7-9d67acca828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e428fce-d67c-4cfe-a22b-98a590bef751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:03 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Volume 9a64cea4-0b79-4d12-86e9-aa55817d9355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a64cea4-0b79-4d12-86e9-aa55817d9355', 'volume_size': 1} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-846588624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a64cea4-0b79-4d12-86e9-aa55817d9355,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bfb0dfe9f8d440498b6bbe7c19f4829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:04Z,use_quota=True,user_id='9082df2f72e14b38962e98b902882f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Creating volume 9a64cea4-0b79-4d12-86e9-aa55817d9355 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:03 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:04 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 1073741824 Sep 03 11:03:04 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:04 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32" returned: 0 in 0.552s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:04 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32 Sep 03 11:03:04 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:04 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0eeafd78-691a-4db7-828c-7e031feccd32" returned: 0 in 0.311s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-quobyte-0eeafd78-691a-4db7-828c-7e031feccd32" released by "delete_volume" :: held 0.919s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:04 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 1073741824" returned: 0 in 0.518s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Created reservations ['d53357f2-5c51-4b51-ad3a-2831bef138f2', 'd1730959-1869-4245-8426-a925253a16f2', '7ca9471e-68e7-4f39-a6b9-28ee29d5bd1d', 'dd76142b-9cb1-4964-899c-80c9ce07b60e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:04 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 Sep 03 11:03:04 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:04 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:04 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:04 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355" returned: 0 in 0.270s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.617s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e428fce-d67c-4cfe-a22b-98a590bef751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a64cea4-0b79-4d12-86e9-aa55817d9355', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24940e2-a9a4-4976-a628-bc83c1e845fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Creating offline snapshot cc097192-ccef-4857-8925-29d6c518fc18 of volume d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:04 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Volume volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 (9a64cea4-0b79-4d12-86e9-aa55817d9355): created successfully Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24940e2-a9a4-4976-a628-bc83c1e845fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:04 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Flow 'volume_create_manager' (de73ad8f-16be-4abe-a17c-a1145abf255e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dce1667-0cbb-46c2-b49b-b8a85a6f500b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.312s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Deleted volume successfully. Sep 03 11:03:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-04f45f0e-9560-41e6-aff8-88719eaff428 req-484496eb-d095-4043-8592-1dfa0112697e tempest-VolumesGetTestJSON-899367130 None] Created volume successfully. Sep 03 11:03:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6df8fb0d-6fcd-4ad3-8bf1-8283f25d9616 tempest-VolumesDeleteCascade-1711411148 None] Lock "cinder-0eeafd78-691a-4db7-828c-7e031feccd32-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:05 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 Sep 03 11:03:05 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:05 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" returned: 0 in 0.462s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:05 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d28e5602-d187-4c15-99f4-65d0d1f24d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:05 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 1G Sep 03 11:03:05 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:05 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 1G" returned: 0 in 0.584s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:06 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 Sep 03 11:03:06 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:06 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18" returned: 0 in 0.461s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:06 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 is being set with open permissions: ugo+rw Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Acquiring lock "cinder-9a64cea4-0b79-4d12-86e9-aa55817d9355-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:06 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Lock "cinder-9a64cea4-0b79-4d12-86e9-aa55817d9355-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:06 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Acquiring lock "cinder-quobyte-9a64cea4-0b79-4d12-86e9-aa55817d9355" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Lock "cinder-quobyte-9a64cea4-0b79-4d12-86e9-aa55817d9355" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ae25b3-cdbd-40e5-bd8f-05ec655fc422]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:06 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 Sep 03 11:03:06 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:06 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18" returned: 0 in 0.372s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:06 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7862f098-cdac-4c6f-8c83-77c110f76d93 tempest-VolumesSnapshotListTestJSON-2102176012 None] Create snapshot completed successfully Sep 03 11:03:07 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355" returned: 0 in 0.468s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:07 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355 Sep 03 11:03:07 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:07 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9a64cea4-0b79-4d12-86e9-aa55817d9355" returned: 0 in 0.278s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Lock "cinder-quobyte-9a64cea4-0b79-4d12-86e9-aa55817d9355" released by "delete_volume" :: held 0.833s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG cinder.quota [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Created reservations ['f745a47f-41b0-4e71-8df7-6a4714de4a5a', 'cd983fe6-6084-4cd1-b587-84a437b9c7c4', '2e0946a5-604d-43c2-831f-3772cc641868', '81051314-c666-47dc-8f61-4175efad0363'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:07 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:07 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Creating offline snapshot 982722ca-8402-4756-855f-2d362942fd27 of volume d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c51f09-596d-4525-a184-607fcc7f15b0]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:07 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 Sep 03 11:03:07 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:08 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.447s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:08 devstack cinder-volume[86603]: DEBUG cinder.manager [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Deleted volume successfully. Sep 03 11:03:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-33a6a0b6-52ce-463a-a82c-1a5e0221d06e req-6bc1e86b-67df-41d6-af19-3774cea8ff9a tempest-VolumesGetTestJSON-899367130 None] Lock "cinder-9a64cea4-0b79-4d12-86e9-aa55817d9355-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:08 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18" returned: 0 in 0.511s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d28e5602-d187-4c15-99f4-65d0d1f24d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:08 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 1G Sep 03 11:03:08 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:09 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 1G" returned: 0 in 0.718s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:09 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 Sep 03 11:03:09 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:09 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27" returned: 0 in 0.522s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:09 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 is being set with open permissions: ugo+rw Sep 03 11:03:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:09 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 Sep 03 11:03:09 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:09 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27" returned: 0 in 0.396s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e64de77d-dc54-4ce6-8e92-c7da4d38c4f6 tempest-VolumesSnapshotListTestJSON-2102176012 None] Create snapshot completed successfully Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Flow 'volume_create_manager' (db870b02-a802-4240-9aea-767ff56293e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01bb5f9-c0f0-400f-b8cf-87e43fe2af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01bb5f9-c0f0-400f-b8cf-87e43fe2af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1465144369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078b4382-a41c-45d5-a5b7-07d02f35197b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418ee54ac806417aa7cbb71fc14388c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:10Z,use_quota=True,user_id='eace6e7ba7b1478fb935f5edf80cff78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5db3bcb-89cf-48dd-a8ba-40f7fcc05923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5db3bcb-89cf-48dd-a8ba-40f7fcc05923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43e0f8f-f6e9-489f-aae4-98db46267b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43e0f8f-f6e9-489f-aae4-98db46267b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '078b4382-a41c-45d5-a5b7-07d02f35197b', 'volume_name': 'volume-078b4382-a41c-45d5-a5b7-07d02f35197b', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23101e4-8b38-4c45-a386-36c5cc780b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23101e4-8b38-4c45-a386-36c5cc780b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64b8631-4862-4840-a6ad-3072c21424a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:10 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Volume 078b4382-a41c-45d5-a5b7-07d02f35197b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-078b4382-a41c-45d5-a5b7-07d02f35197b', 'volume_size': 1} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1465144369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078b4382-a41c-45d5-a5b7-07d02f35197b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418ee54ac806417aa7cbb71fc14388c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:10Z,use_quota=True,user_id='eace6e7ba7b1478fb935f5edf80cff78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Creating volume 078b4382-a41c-45d5-a5b7-07d02f35197b {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:10 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:10 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b 1073741824 Sep 03 11:03:10 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:11 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b 1073741824" returned: 0 in 0.599s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=180,cinder:SELECT=160,cinder:INSERT=48,cinder:DELETE=11 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:11 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b Sep 03 11:03:11 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:11 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b" returned: 0 in 0.406s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64b8631-4862-4840-a6ad-3072c21424a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-078b4382-a41c-45d5-a5b7-07d02f35197b', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c313a38-4db3-42bc-8906-b605babe1844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:11 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Volume volume-078b4382-a41c-45d5-a5b7-07d02f35197b (078b4382-a41c-45d5-a5b7-07d02f35197b): created successfully Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c313a38-4db3-42bc-8906-b605babe1844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Flow 'volume_create_manager' (db870b02-a802-4240-9aea-767ff56293e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3c6eb67b-36d6-4720-bc4a-a6bb0f54b54d tempest-VolumesMetadataTest-1017539640 None] Created volume successfully. Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-982722ca-8402-4756-855f-2d362942fd27-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-982722ca-8402-4756-855f-2d362942fd27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-quobyte-982722ca-8402-4756-855f-2d362942fd27" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-982722ca-8402-4756-855f-2d362942fd27" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Deleting offline snapshot 982722ca-8402-4756-855f-2d362942fd27 of volume d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] snapshot_file for this snap is: volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aab086e-4256-45d1-8107-357d766970f5]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:12 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 Sep 03 11:03:12 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:12 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27" returned: 0 in 0.397s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d28e5602-d187-4c15-99f4-65d0d1f24d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[92299ca9-a27f-41ea-b8d0-ed6539761f45]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:12 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 Sep 03 11:03:12 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:13 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18" returned: 0 in 0.677s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d28e5602-d187-4c15-99f4-65d0d1f24d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:13 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 Sep 03 11:03:13 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Flow 'volume_create_manager' (b5eed22f-b9c6-4c11-9973-0b5bd9ed9771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fa7056-37b4-4a6b-8faf-0e9311a1c79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fa7056-37b4-4a6b-8faf-0e9311a1c79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1062926922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d7da32-b7da-4aa4-99de-b49cdc4d953c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7aee612edef84a65889624a78773d190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:13Z,use_quota=True,user_id='d7911d101da84ffc90b3f55f87cd11a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a2e4cb-5db5-4428-9d15-01ce336e4d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a2e4cb-5db5-4428-9d15-01ce336e4d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e7b25b-9b4c-4945-9501-b7aeeae5e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e7b25b-9b4c-4945-9501-b7aeeae5e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d7da32-b7da-4aa4-99de-b49cdc4d953c', 'volume_name': 'volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3ac539-b1f7-4c55-9237-5fd03308d2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3ac539-b1f7-4c55-9237-5fd03308d2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c050ad10-4ae8-498f-b900-4560711f800b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Volume 21d7da32-b7da-4aa4-99de-b49cdc4d953c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c', 'volume_size': 1} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1062926922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d7da32-b7da-4aa4-99de-b49cdc4d953c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7aee612edef84a65889624a78773d190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:13Z,use_quota=True,user_id='d7911d101da84ffc90b3f55f87cd11a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Creating volume 21d7da32-b7da-4aa4-99de-b49cdc4d953c {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:13 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:13 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c 1073741824 Sep 03 11:03:13 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Acquiring lock "cinder-078b4382-a41c-45d5-a5b7-07d02f35197b-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Lock "cinder-078b4382-a41c-45d5-a5b7-07d02f35197b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Acquiring lock "cinder-quobyte-078b4382-a41c-45d5-a5b7-07d02f35197b" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Lock "cinder-quobyte-078b4382-a41c-45d5-a5b7-07d02f35197b" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[608cb1c6-952f-4b92-b391-90b495b44c3b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:14 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27" returned: 0 in 0.736s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:14 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27 Sep 03 11:03:14 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:14 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b Sep 03 11:03:14 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:14 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c 1073741824" returned: 0 in 0.758s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:14 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.982722ca-8402-4756-855f-2d362942fd27" returned: 0 in 0.349s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-982722ca-8402-4756-855f-2d362942fd27" released by "_delete_snapshot" :: held 2.313s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" released by "delete_snapshot" :: held 2.343s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:14 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c Sep 03 11:03:14 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Created reservations ['d131437d-daed-4de4-8fd3-5e7bfbaef30e', '782735e6-87f6-4be9-931b-a5577aba6cce', '299511aa-018d-4637-8867-0f849198b29f', '8d4578a9-0223-42de-8af3-da8d2131446b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:14 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b" returned: 0 in 0.615s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:14 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b Sep 03 11:03:14 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Delete snapshot completed successfully. Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e205933-8bb7-45e0-bf63-1c89527d9fc0 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-982722ca-8402-4756-855f-2d362942fd27-delete_snapshot" released by "delete_snapshot" :: held 2.637s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:14 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c" returned: 0 in 0.352s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c050ad10-4ae8-498f-b900-4560711f800b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026f6809-742f-4c3f-b165-8b5c1c733452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (b585176a-8b66-4ac3-822d-71197ea47b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df0a652-2019-4837-a3fa-762658065e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:14 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Volume volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c (21d7da32-b7da-4aa4-99de-b49cdc4d953c): created successfully Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026f6809-742f-4c3f-b165-8b5c1c733452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Flow 'volume_create_manager' (b5eed22f-b9c6-4c11-9973-0b5bd9ed9771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df0a652-2019-4837-a3fa-762658065e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2122241949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c698c5-5811-441e-808d-f5a85df15735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b49c786262046a7a573c1592bcd4be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:15Z,use_quota=True,user_id='edff3bdc6546415d9f34b83ff8e94e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63962a57-91fe-4814-bc11-7e343913b42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63962a57-91fe-4814-bc11-7e343913b42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3a64d1-d872-4449-8c95-ee707e019ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3a64d1-d872-4449-8c95-ee707e019ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c698c5-5811-441e-808d-f5a85df15735', 'volume_name': 'volume-80c698c5-5811-441e-808d-f5a85df15735', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7cdd776-fbf0-4025-bbde-c1a0f884f837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7cdd776-fbf0-4025-bbde-c1a0f884f837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efb1a17-dbc1-4dfc-902f-f8f5158f6d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:15 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Volume 80c698c5-5811-441e-808d-f5a85df15735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c698c5-5811-441e-808d-f5a85df15735', 'volume_size': 1} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:15 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2122241949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c698c5-5811-441e-808d-f5a85df15735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b49c786262046a7a573c1592bcd4be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:15Z,use_quota=True,user_id='edff3bdc6546415d9f34b83ff8e94e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Creating volume 80c698c5-5811-441e-808d-f5a85df15735 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:15 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-078b4382-a41c-45d5-a5b7-07d02f35197b" returned: 0 in 0.318s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-243421ea-6f98-4003-adc8-2d162650d6af tempest-VolumesTestJSON-661849563 None] Created volume successfully. Sep 03 11:03:15 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 1073741824 Sep 03 11:03:15 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Lock "cinder-quobyte-078b4382-a41c-45d5-a5b7-07d02f35197b" released by "delete_volume" :: held 1.001s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Created reservations ['0e32c619-c68d-4a0a-ab3b-ab2e010880f5', '1369f8a2-bcca-4b12-a204-6ccd3c8c9e26', 'c149f019-ed7f-44e6-a110-63a6794e12b8', '246174d5-e83e-444c-95b1-9529160d9012'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:15 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:15 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:15 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-cc097192-ccef-4857-8925-29d6c518fc18-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.284s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:15 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 1073741824" returned: 0 in 0.462s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Deleted volume successfully. Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-cc097192-ccef-4857-8925-29d6c518fc18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-quobyte-cc097192-ccef-4857-8925-29d6c518fc18" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a8dd0376-35b0-44c1-9f9e-07c048ec1fde tempest-VolumesMetadataTest-1017539640 None] Lock "cinder-078b4382-a41c-45d5-a5b7-07d02f35197b-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-cc097192-ccef-4857-8925-29d6c518fc18" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Deleting offline snapshot cc097192-ccef-4857-8925-29d6c518fc18 of volume d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] snapshot_file for this snap is: volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c0ae46-2ce6-4897-b7b0-265fa8bf6095]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:15 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 Sep 03 11:03:15 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:15 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 Sep 03 11:03:15 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:15 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735" returned: 0 in 0.290s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efb1a17-dbc1-4dfc-902f-f8f5158f6d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c698c5-5811-441e-808d-f5a85df15735', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb657a0e-2181-40dc-947f-c51d90068df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:15 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Volume volume-80c698c5-5811-441e-808d-f5a85df15735 (80c698c5-5811-441e-808d-f5a85df15735): created successfully Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb657a0e-2181-40dc-947f-c51d90068df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (b585176a-8b66-4ac3-822d-71197ea47b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9e33df87-abf3-400d-bc2a-eac16d9e0fc1 tempest-VolumesSnapshotTestJSON-72310612 None] Created volume successfully. Sep 03 11:03:16 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18" returned: 0 in 0.435s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d28e5602-d187-4c15-99f4-65d0d1f24d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[467e8e47-9991-4246-b243-6358258b7a9f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:16 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 Sep 03 11:03:16 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Flow 'volume_create_manager' (ec71d1a5-5708-4cc5-b5e3-5137474fa0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5ab937-b3b3-4efb-9df6-8a2fbab6da1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5ab937-b3b3-4efb-9df6-8a2fbab6da1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1634040900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aead677f-0b2a-4009-a833-932e09a149d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7aee612edef84a65889624a78773d190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:16Z,use_quota=True,user_id='d7911d101da84ffc90b3f55f87cd11a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31632c20-29ae-4aba-a6e8-79226a1121ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31632c20-29ae-4aba-a6e8-79226a1121ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee95909-52de-4c0c-a3ec-02b2eae352e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee95909-52de-4c0c-a3ec-02b2eae352e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aead677f-0b2a-4009-a833-932e09a149d7', 'volume_name': 'volume-aead677f-0b2a-4009-a833-932e09a149d7', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4317aec8-5c71-484f-808b-367831b08d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4317aec8-5c71-484f-808b-367831b08d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04485e74-c455-4f93-b919-9a8e54f43022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:16 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Volume aead677f-0b2a-4009-a833-932e09a149d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aead677f-0b2a-4009-a833-932e09a149d7', 'volume_size': 1} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1634040900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aead677f-0b2a-4009-a833-932e09a149d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7aee612edef84a65889624a78773d190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:16Z,use_quota=True,user_id='d7911d101da84ffc90b3f55f87cd11a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Creating volume aead677f-0b2a-4009-a833-932e09a149d7 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:16 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:16 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7 1073741824 Sep 03 11:03:16 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:16 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" returned: 0 in 0.418s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d28e5602-d187-4c15-99f4-65d0d1f24d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:16 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 Sep 03 11:03:16 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:16 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7 1073741824" returned: 0 in 0.481s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:16 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7 Sep 03 11:03:16 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:16 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18" returned: 0 in 0.463s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:16 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18 Sep 03 11:03:16 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:17 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7" returned: 0 in 0.412s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04485e74-c455-4f93-b919-9a8e54f43022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aead677f-0b2a-4009-a833-932e09a149d7', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91ffb03-77f1-486f-a373-cf211a1d1c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:17 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:17 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Volume volume-aead677f-0b2a-4009-a833-932e09a149d7 (aead677f-0b2a-4009-a833-932e09a149d7): created successfully Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91ffb03-77f1-486f-a373-cf211a1d1c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Flow 'volume_create_manager' (ec71d1a5-5708-4cc5-b5e3-5137474fa0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.cc097192-ccef-4857-8925-29d6c518fc18" returned: 0 in 0.378s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-cc097192-ccef-4857-8925-29d6c518fc18" released by "_delete_snapshot" :: held 1.812s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" released by "delete_snapshot" :: held 1.844s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e5816127-84f2-4d82-a717-dfc94c3c8a3d tempest-VolumesTestJSON-661849563 None] Created volume successfully. Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Created reservations ['b9e9e4c9-d534-44ff-8557-24147b41b4d7', '8d54cc2f-bb5e-4af8-b367-cbe9edb33734', 'b9e5f762-3d16-402c-9c49-e957d407ae31', '6fb7ba53-5e08-4219-8b2f-cede897f64ca'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Creating offline snapshot 863976cc-f3bc-4d05-9ac8-6e010ea38173 of volume 80c698c5-5811-441e-808d-f5a85df15735 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5461dd-9693-4e1b-9c54-ebac9db65b75]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Delete snapshot completed successfully. Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6bc844d-6791-41ae-9713-949b92dd891c tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-cc097192-ccef-4857-8925-29d6c518fc18-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:17 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 Sep 03 11:03:17 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-0d0fffa9-bd6f-4009-a828-7b2fb56bcb26-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-0d0fffa9-bd6f-4009-a828-7b2fb56bcb26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-quobyte-0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Deleting offline snapshot 0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 of volume d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] snapshot_file for this snap is: volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b8a556-c545-4f93-906f-2986fa4d976d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:17 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 Sep 03 11:03:17 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:17 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735" returned: 0 in 0.464s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:18 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 1G Sep 03 11:03:18 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:18 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" returned: 0 in 0.435s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d28e5602-d187-4c15-99f4-65d0d1f24d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa927d21-2ada-4e3c-9f9c-6960b3e89d41]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:18 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 Sep 03 11:03:18 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:18 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 1G" returned: 0 in 0.496s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c698c5-5811-441e-808d-f5a85df15735 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:18 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c698c5-5811-441e-808d-f5a85df15735 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 Sep 03 11:03:18 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:18 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21" returned: 0 in 0.465s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:18 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 Sep 03 11:03:18 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:18 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c698c5-5811-441e-808d-f5a85df15735 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173" returned: 0 in 0.421s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:18 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 is being set with open permissions: ugo+rw Sep 03 11:03:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:18 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 Sep 03 11:03:18 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Flow 'volume_create_manager' (d3f9b88c-a00c-4d31-a681-a8b61f2b5059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef401e5-8cda-4c85-a919-199904e423b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef401e5-8cda-4c85-a919-199904e423b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1713045969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11006b19-dac0-4eea-ad75-8ff26ab257b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7aee612edef84a65889624a78773d190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:19Z,use_quota=True,user_id='d7911d101da84ffc90b3f55f87cd11a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14491e40-02e2-45de-a26e-17bcfa06e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14491e40-02e2-45de-a26e-17bcfa06e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1d9ca9-c9b3-443b-bdc4-cf5fddc44e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1d9ca9-c9b3-443b-bdc4-cf5fddc44e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11006b19-dac0-4eea-ad75-8ff26ab257b2', 'volume_name': 'volume-11006b19-dac0-4eea-ad75-8ff26ab257b2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e20d7d-81fb-4886-b659-9b655e961efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e20d7d-81fb-4886-b659-9b655e961efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:19 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64db73d9-b2e6-4e20-891c-e1b7b56f1f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:19 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Volume 11006b19-dac0-4eea-ad75-8ff26ab257b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11006b19-dac0-4eea-ad75-8ff26ab257b2', 'volume_size': 1} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" returned: 0 in 0.436s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:19 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26 Sep 03 11:03:19 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:19 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173" returned: 0 in 0.325s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:19 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.info Sep 03 11:03:19 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:19 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21.0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" returned: 0 in 0.277s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-0d0fffa9-bd6f-4009-a828-7b2fb56bcb26" released by "_delete_snapshot" :: held 1.742s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" released by "delete_snapshot" :: held 1.771s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:19 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.info" returned: 0 in 0.292s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:19 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.info is being set with open permissions: ugo+rw Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:19 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.info Sep 03 11:03:19 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Created reservations ['db2d096c-62c4-4f82-8dd2-396e6745e1e2', 'fb92778b-5bba-444c-a90f-30d005af02a5', '73ba62fa-6ac6-42ad-b70d-ef57c1c8d745', '569f6781-7280-43c0-843f-188b6a99ddb9'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:19 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Delete snapshot completed successfully. Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-528c0ace-54ae-4255-9ef4-238f73007c57 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-0d0fffa9-bd6f-4009-a828-7b2fb56bcb26-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:19 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.info" returned: 0 in 0.282s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1713045969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11006b19-dac0-4eea-ad75-8ff26ab257b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7aee612edef84a65889624a78773d190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:19Z,use_quota=True,user_id='d7911d101da84ffc90b3f55f87cd11a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Creating volume 11006b19-dac0-4eea-ad75-8ff26ab257b2 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:19 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:19 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 1073741824 Sep 03 11:03:19 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:19 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9e2f3451-ec1b-4b84-a456-d247d8bf146f tempest-VolumesSnapshotTestJSON-72310612 None] Create snapshot completed successfully Sep 03 11:03:19 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-d28e5602-d187-4c15-99f4-65d0d1f24d21-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-d28e5602-d187-4c15-99f4-65d0d1f24d21-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dc4f81-4f02-459e-b289-fb808cf653fc]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:20 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 Sep 03 11:03:20 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Flow 'volume_create_manager' (a6bc44e4-5f6b-4089-9b6a-f6c054e83c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d43486-da3a-4207-b14e-3f34f295b25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d43486-da3a-4207-b14e-3f34f295b25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1625926878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c186c1a3-d6af-477f-bb88-a733135afeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecc0e954b6844fe8524e6838ae78b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:20Z,use_quota=True,user_id='7fbe0d32fb2a4ff0917c400a925a1c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136016c9-b046-4b19-8555-323f2f5a6c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136016c9-b046-4b19-8555-323f2f5a6c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9579d095-fffd-48c3-be00-2589cd904094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:03:20 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 1073741824" returned: 0 in 0.602s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:20 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 Sep 03 11:03:20 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:20 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21" returned: 0 in 0.455s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:20 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21 Sep 03 11:03:20 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9579d095-fffd-48c3-be00-2589cd904094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c186c1a3-d6af-477f-bb88-a733135afeb1', 'volume_name': 'volume-c186c1a3-d6af-477f-bb88-a733135afeb1', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f129a5-5564-40e1-b1f3-be5a053fc46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f129a5-5564-40e1-b1f3-be5a053fc46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c609c6-d0cf-4502-9ce1-97a15af1d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:20 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Volume c186c1a3-d6af-477f-bb88-a733135afeb1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c186c1a3-d6af-477f-bb88-a733135afeb1', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Trying to clone c186c1a3-d6af-477f-bb88-a733135afeb1 from image f9d13994-8b06-4b71-9618-b02e2701e179 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-863976cc-f3bc-4d05-9ac8-6e010ea38173-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:20 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2" returned: 0 in 0.320s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-863976cc-f3bc-4d05-9ac8-6e010ea38173-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64db73d9-b2e6-4e20-891c-e1b7b56f1f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11006b19-dac0-4eea-ad75-8ff26ab257b2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0fba30-b83d-4c82-a1f2-2edc3fe9266a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:20 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:20 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Volume volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 (11006b19-dac0-4eea-ad75-8ff26ab257b2): created successfully Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0fba30-b83d-4c82-a1f2-2edc3fe9266a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Flow 'volume_create_manager' (d3f9b88c-a00c-4d31-a681-a8b61f2b5059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d28e5602-d187-4c15-99f4-65d0d1f24d21" returned: 0 in 0.373s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:20 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-de9b2bf6-9b14-4863-b72c-ca83474c3814 tempest-VolumesTestJSON-661849563 None] Created volume successfully. Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-quobyte-d28e5602-d187-4c15-99f4-65d0d1f24d21" released by "delete_volume" :: held 0.918s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-80c698c5-5811-441e-808d-f5a85df15735" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-80c698c5-5811-441e-808d-f5a85df15735" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-863976cc-f3bc-4d05-9ac8-6e010ea38173" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-863976cc-f3bc-4d05-9ac8-6e010ea38173" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Deleting offline snapshot 863976cc-f3bc-4d05-9ac8-6e010ea38173 of volume 80c698c5-5811-441e-808d-f5a85df15735 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] snapshot_file for this snap is: volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a1b4d4-c3d0-4e16-af13-a629d95b07dd]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:03:21 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Created reservations ['bf514174-68a5-4f25-aa76-2da16f191984', 'c7a84696-97e8-4259-bd03-7a1ce3bfd11b', 'cff7da08-b8fa-4afc-9493-caf74e60133c', '85a5844a-da38-4847-b6ae-8f85d72d1306'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13179eb-f96a-4f16-9bb9-d55d09699711]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:21 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 Sep 03 11:03:21 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:21 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:21 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:21 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD Sep 03 11:03:21 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:21 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173" returned: 0 in 0.425s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80c698c5-5811-441e-808d-f5a85df15735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[303e781b-23a8-4c40-ad43-2dcdaa0651b6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:21 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:21 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.327s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 is fetched for user 7fbe0d32fb2a4ff0917c400a925a1c3e. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:21 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Deleted volume successfully. Sep 03 11:03:21 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 Sep 03 11:03:21 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b8ecb978-73d0-4594-aff7-b7d6c136b4b1 tempest-VolumesSnapshotListTestJSON-2102176012 None] Lock "cinder-d28e5602-d187-4c15-99f4-65d0d1f24d21-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5326e241-488c-40a1-935d-bd1008d71a38]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:21 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD Sep 03 11:03:21 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:22 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735" returned: 0 in 0.484s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:22 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 Sep 03 11:03:22 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:22 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1625926878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c186c1a3-d6af-477f-bb88-a733135afeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecc0e954b6844fe8524e6838ae78b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:20Z,use_quota=True,user_id='7fbe0d32fb2a4ff0917c400a925a1c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Creating volume c186c1a3-d6af-477f-bb88-a733135afeb1 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:22 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:22 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 1073741824 Sep 03 11:03:22 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Acquiring lock "cinder-11006b19-dac0-4eea-ad75-8ff26ab257b2-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Lock "cinder-11006b19-dac0-4eea-ad75-8ff26ab257b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Acquiring lock "cinder-quobyte-11006b19-dac0-4eea-ad75-8ff26ab257b2" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Lock "cinder-quobyte-11006b19-dac0-4eea-ad75-8ff26ab257b2" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ea1ea7-339f-41a5-89d9-17f385ca414c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:22 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173" returned: 0 in 0.485s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:22 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173 Sep 03 11:03:22 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:22 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 Sep 03 11:03:22 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:22 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 1073741824" returned: 0 in 0.552s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:22 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 Sep 03 11:03:22 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:22 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735.863976cc-f3bc-4d05-9ac8-6e010ea38173" returned: 0 in 0.345s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:22 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=190,cinder:SELECT=151,cinder:DELETE=21,cinder:INSERT=45 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2" returned: 0 in 0.461s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:22 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2 Sep 03 11:03:22 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-863976cc-f3bc-4d05-9ac8-6e010ea38173" released by "_delete_snapshot" :: held 1.907s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-80c698c5-5811-441e-808d-f5a85df15735" released by "delete_snapshot" :: held 1.942s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Created reservations ['9afef8d6-3b4c-4b0a-b63d-b8e37d8e892e', 'f55922e4-7375-4963-8b38-83bede191012', 'f1b39c7e-38c0-46ac-8105-3392dfc5e029', '74484dbf-21ab-45fd-a541-7703bc6ef50d'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:23 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1" returned: 0 in 0.315s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Attempting download of f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume c186c1a3-d6af-477f-bb88-a733135afeb1. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:03:23 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Delete snapshot completed successfully. Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31ed0fe0-0c6b-45ef-b494-1f3eb7532a84 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-863976cc-f3bc-4d05-9ac8-6e010ea38173-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d6ec02-294e-4a4e-8b3f-590f85bc1bf8]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_ffdri8a4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:23 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11006b19-dac0-4eea-ad75-8ff26ab257b2" returned: 0 in 0.343s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Lock "cinder-quobyte-11006b19-dac0-4eea-ad75-8ff26ab257b2" released by "delete_volume" :: held 0.846s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Created reservations ['3115640a-b027-4cab-a53e-225bc13bcf7d', 'd000b064-2ea3-464a-9812-04b527e62046', '9d715d6c-ed2e-4cfa-8838-1e7c35523b00', 'b1be7d56-93e2-4f57-9723-4c2e8d0532cf'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:23 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_ffdri8a4 Sep 03 11:03:23 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:23 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:23 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:23 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:23 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Acquiring lock "cinder-aead677f-0b2a-4009-a833-932e09a149d7-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Lock "cinder-aead677f-0b2a-4009-a833-932e09a149d7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:23 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_ffdri8a4" returned: 0 in 0.430s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_ffdri8a4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Acquiring lock "cinder-quobyte-aead677f-0b2a-4009-a833-932e09a149d7" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Lock "cinder-quobyte-aead677f-0b2a-4009-a833-932e09a149d7" acquired by "delete_volume" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b78dd4c-7dfa-45dc-b2f4-43beb6d54a4d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:23 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_ffdri8a4 Sep 03 11:03:23 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:23 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.372s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:23 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.420s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:23 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Deleted volume successfully. Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-28a72aeb-f8b5-4f47-95ec-c39510a35532 tempest-VolumesTestJSON-661849563 None] Lock "cinder-11006b19-dac0-4eea-ad75-8ff26ab257b2-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:03:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:03:24 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7 Sep 03 11:03:24 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:24 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_ffdri8a4" returned: 1 in 0.525s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_ffdri8a4' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[380a9dda-4e64-42f9-9871-ff0cb370ba82]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:24 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7" returned: 0 in 0.524s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:24 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7 Sep 03 11:03:24 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD Sep 03 11:03:24 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:24 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:24 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aead677f-0b2a-4009-a833-932e09a149d7" returned: 0 in 0.354s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Lock "cinder-quobyte-aead677f-0b2a-4009-a833-932e09a149d7" released by "delete_volume" :: held 0.939s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:24 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] f9d13994-8b06-4b71-9618-b02e2701e179 was qcow2, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:24 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 Sep 03 11:03:24 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (300c9560-f9a6-4e04-91f9-83bc48ca6cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbeeaad9-5293-4b21-a8ec-3ed9f3ea430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbeeaad9-5293-4b21-a8ec-3ed9f3ea430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1238727201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2ccebe-bb54-436b-aca7-930e380c3696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b49c786262046a7a573c1592bcd4be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:25Z,use_quota=True,user_id='edff3bdc6546415d9f34b83ff8e94e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a02227-0e9f-4174-bb0c-a1e691398388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a02227-0e9f-4174-bb0c-a1e691398388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a59d5d7-d3f6-4e9f-b453-7b622c1e0acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a59d5d7-d3f6-4e9f-b453-7b622c1e0acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2ccebe-bb54-436b-aca7-930e380c3696', 'volume_name': 'volume-aa2ccebe-bb54-436b-aca7-930e380c3696', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7bfc1b-ec65-4c55-847c-62e43058d028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7bfc1b-ec65-4c55-847c-62e43058d028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ac772b-82f8-4211-95d6-6335483c13db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:24 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Volume aa2ccebe-bb54-436b-aca7-930e380c3696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2ccebe-bb54-436b-aca7-930e380c3696', 'volume_size': 1} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1238727201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2ccebe-bb54-436b-aca7-930e380c3696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b49c786262046a7a573c1592bcd4be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:25Z,use_quota=True,user_id='edff3bdc6546415d9f34b83ff8e94e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Creating volume aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:24 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:24 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 1073741824 Sep 03 11:03:24 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Created reservations ['afb7de98-dcd3-427a-a226-38dda1837cf8', '27d4494b-39b8-4108-b619-9c856e015c8f', 'e465bd2d-f1e5-48a4-910c-b9edf22241e8', 'e64b6647-2835-4b14-929c-c543470473f1'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:24 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:25 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:25 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:25 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.315s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Deleted volume successfully. Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a231d072-42b9-409a-aa14-9e7a986003a0 tempest-VolumesTestJSON-661849563 None] Lock "cinder-aead677f-0b2a-4009-a833-932e09a149d7-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:25 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 1073741824" returned: 0 in 0.511s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:25 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 Sep 03 11:03:25 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:25 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696" returned: 0 in 0.329s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ac772b-82f8-4211-95d6-6335483c13db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2ccebe-bb54-436b-aca7-930e380c3696', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03301bc-21c2-4432-9d47-0ebd1d57efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:25 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Volume volume-aa2ccebe-bb54-436b-aca7-930e380c3696 (aa2ccebe-bb54-436b-aca7-930e380c3696): created successfully Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03301bc-21c2-4432-9d47-0ebd1d57efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (300c9560-f9a6-4e04-91f9-83bc48ca6cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0964275d-09a7-4087-bd3f-f004e464fc9e tempest-VolumesSnapshotTestJSON-72310612 None] Created volume successfully. Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Acquiring lock "cinder-21d7da32-b7da-4aa4-99de-b49cdc4d953c-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Lock "cinder-21d7da32-b7da-4aa4-99de-b49cdc4d953c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Acquiring lock "cinder-quobyte-21d7da32-b7da-4aa4-99de-b49cdc4d953c" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Lock "cinder-quobyte-21d7da32-b7da-4aa4-99de-b49cdc4d953c" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:26 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d86c4e2-6575-40d6-b1a3-e04613b94550]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:26 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c Sep 03 11:03:26 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:26 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c" returned: 0 in 0.469s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:26 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c Sep 03 11:03:26 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:26 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-21d7da32-b7da-4aa4-99de-b49cdc4d953c" returned: 0 in 0.333s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Lock "cinder-quobyte-21d7da32-b7da-4aa4-99de-b49cdc4d953c" released by "delete_volume" :: held 0.854s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:26 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Created reservations ['f43c49ef-0b52-4a0b-9b3c-4326f25f46fe', 'd46bf1da-8418-4ed3-b81b-e5877c7d26b8', '19f8c858-47b1-44e3-a44b-3843ff2404b7', '4ea204fc-0b8c-4c7d-8d69-f268ec4283f3'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:27 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1" returned: 0 in 2.318s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_ltdqoeiddevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:03:27 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Converted 112.00 MB image at 48.28 MB/s Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:27 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 1G Sep 03 11:03:27 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:27 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:27 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Creating offline snapshot b95797e1-e76f-4bdd-8b09-1d17748ee880 of volume aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b75d09-023a-42f1-b126-4d7f2c7f2512]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:27 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 Sep 03 11:03:27 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:27 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.389s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:27 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Deleted volume successfully. Sep 03 11:03:27 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 1G" returned: 0 in 0.470s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Downloaded image f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume c186c1a3-d6af-477f-bb88-a733135afeb1 successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 for user 7fbe0d32fb2a4ff0917c400a925a1c3e is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Marking volume c186c1a3-d6af-477f-bb88-a733135afeb1 as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Copying metadata from image f9d13994-8b06-4b71-9618-b02e2701e179 to c186c1a3-d6af-477f-bb88-a733135afeb1. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Creating volume glance metadata for volume c186c1a3-d6af-477f-bb88-a733135afeb1 backed by image f9d13994-8b06-4b71-9618-b02e2701e179 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e57fe143-dfa9-4565-abc1-5c9e9e4165b1 tempest-VolumesTestJSON-661849563 None] Lock "cinder-21d7da32-b7da-4aa4-99de-b49cdc4d953c-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c609c6-d0cf-4502-9ce1-97a15af1d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c186c1a3-d6af-477f-bb88-a733135afeb1', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708b902e-8487-4d37-8c29-cc35a9368824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:27 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Volume volume-c186c1a3-d6af-477f-bb88-a733135afeb1 (c186c1a3-d6af-477f-bb88-a733135afeb1): created successfully Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708b902e-8487-4d37-8c29-cc35a9368824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Flow 'volume_create_manager' (a6bc44e4-5f6b-4089-9b6a-f6c054e83c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:27 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-92ff5a5d-003e-4531-821e-9319035568c0 tempest-VolumesExtendTest-915657212 None] Created volume successfully. Sep 03 11:03:27 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696" returned: 0 in 0.598s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:27 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 1G Sep 03 11:03:27 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-742a7098-ee50-4b7d-8e8a-57c99721e93d tempest-VolumesExtendTest-915657212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:28 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 1G" returned: 0 in 0.498s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2ccebe-bb54-436b-aca7-930e380c3696 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:28 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2ccebe-bb54-436b-aca7-930e380c3696 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 Sep 03 11:03:28 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:28 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2ccebe-bb54-436b-aca7-930e380c3696 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880" returned: 0 in 0.371s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:28 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 is being set with open permissions: ugo+rw Sep 03 11:03:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:28 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 Sep 03 11:03:28 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:28 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880" returned: 0 in 0.286s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:29 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.info Sep 03 11:03:29 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:29 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.info" returned: 0 in 0.305s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:29 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.info is being set with open permissions: ugo+rw Sep 03 11:03:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:29 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.info Sep 03 11:03:29 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:29 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.info" returned: 0 in 0.282s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-742a7098-ee50-4b7d-8e8a-57c99721e93d tempest-VolumesExtendTest-915657212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.631s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:29 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[903beca3-fb86-44f1-ad2d-d724fabd910b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-742a7098-ee50-4b7d-8e8a-57c99721e93d tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:29 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-22e93855-c204-4cdb-9caa-72658e1c8ca9 tempest-VolumesSnapshotTestJSON-72310612 None] Create snapshot completed successfully Sep 03 11:03:29 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 Sep 03 11:03:29 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:30 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-742a7098-ee50-4b7d-8e8a-57c99721e93d tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1" returned: 0 in 0.488s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-742a7098-ee50-4b7d-8e8a-57c99721e93d tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 2G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-742a7098-ee50-4b7d-8e8a-57c99721e93d tempest-VolumesExtendTest-915657212 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 2G" returned: 0 in 0.145s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-742a7098-ee50-4b7d-8e8a-57c99721e93d tempest-VolumesExtendTest-915657212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.681s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:30 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-742a7098-ee50-4b7d-8e8a-57c99721e93d tempest-VolumesExtendTest-915657212 None] Extend volume completed successfully. Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (d34c04ee-551a-4a45-8cb8-2e64545e2950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73853855-eab6-47ef-b27a-f36fb64af854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73853855-eab6-47ef-b27a-f36fb64af854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-740385415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7520c96e-1f35-48c6-b4f2-a7900fd08b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b49c786262046a7a573c1592bcd4be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b95797e1-e76f-4bdd-8b09-1d17748ee880,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:31Z,use_quota=True,user_id='edff3bdc6546415d9f34b83ff8e94e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce2ff1c-4e16-4ddf-b101-29204b65334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce2ff1c-4e16-4ddf-b101-29204b65334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeb9939-24b9-4b4a-8b76-342a571ca07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeb9939-24b9-4b4a-8b76-342a571ca07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7520c96e-1f35-48c6-b4f2-a7900fd08b3d', 'volume_name': 'volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d', 'volume_size': 2, 'snapshot_id': 'b95797e1-e76f-4bdd-8b09-1d17748ee880'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01c4aa0-bad5-4a1b-a461-fe366a6f1034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01c4aa0-bad5-4a1b-a461-fe366a6f1034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc208c41-293d-4d43-8127-71d91feb4029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:31 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Volume 7520c96e-1f35-48c6-b4f2-a7900fd08b3d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d', 'volume_size': 2, 'snapshot_id': 'b95797e1-e76f-4bdd-8b09-1d17748ee880'} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-b95797e1-e76f-4bdd-8b09-1d17748ee880-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" by "_create_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-b95797e1-e76f-4bdd-8b09-1d17748ee880-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Creating volume 7520c96e-1f35-48c6-b4f2-a7900fd08b3d from snapshot b95797e1-e76f-4bdd-8b09-1d17748ee880 {{(pid=86603) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] snapshot: b95797e1-e76f-4bdd-8b09-1d17748ee880, volume: 7520c96e-1f35-48c6-b4f2-a7900fd08b3d, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a357f12-0d96-4df3-920d-74582a1ab014]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:31 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 Sep 03 11:03:31 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Acquiring lock "cinder-c186c1a3-d6af-477f-bb88-a733135afeb1-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Lock "cinder-c186c1a3-d6af-477f-bb88-a733135afeb1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Acquiring lock "cinder-quobyte-c186c1a3-d6af-477f-bb88-a733135afeb1" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:31 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Lock "cinder-quobyte-c186c1a3-d6af-477f-bb88-a733135afeb1" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880" returned: 0 in 0.704s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa2ccebe-bb54-436b-aca7-930e380c3696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a4477e-0c72-4109-8db4-9134d2cc5728]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5911495-bd47-4a28-aef5-85a2a6e4fde3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:31 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 Sep 03 11:03:31 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:32 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 Sep 03 11:03:32 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:32 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696" returned: 0 in 0.558s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:32 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1" returned: 0 in 0.620s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:32 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d Sep 03 11:03:32 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:32 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1 Sep 03 11:03:32 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Flow 'volume_create_manager' (2d5fc6ac-641b-4776-8aaa-11eaf0a3938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56435eae-7e51-452d-b0d7-aa13e4fdb68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56435eae-7e51-452d-b0d7-aa13e4fdb68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-76489479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511d94c8-4d33-4bbd-91cb-16a081eee726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9783bc307b54ed68eac0e57ca7e5231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:32Z,use_quota=True,user_id='a16a18c8b4974659898d4faebdabdc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbdd996-0a25-4c3a-8317-d2d6c5492b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbdd996-0a25-4c3a-8317-d2d6c5492b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0274c1d-bb71-46d9-9486-7b5d64074200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0274c1d-bb71-46d9-9486-7b5d64074200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511d94c8-4d33-4bbd-91cb-16a081eee726', 'volume_name': 'volume-511d94c8-4d33-4bbd-91cb-16a081eee726', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1443bbb-eaf1-4dec-960d-0597e7aaa204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1443bbb-eaf1-4dec-960d-0597e7aaa204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e7ebb6-b64e-4c03-9065-bcde08b40685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:32 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Volume 511d94c8-4d33-4bbd-91cb-16a081eee726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511d94c8-4d33-4bbd-91cb-16a081eee726', 'volume_size': 1} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:32 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c186c1a3-d6af-477f-bb88-a733135afeb1" returned: 0 in 0.422s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Lock "cinder-quobyte-c186c1a3-d6af-477f-bb88-a733135afeb1" released by "delete_volume" :: held 1.107s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:32 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Created reservations ['59b789f9-e983-428b-9a72-60db04331538', 'f817225a-fa90-4195-8909-5383c44b3abc', '16d40135-51ae-4c3f-841b-0c7d306508a7', '15e73ce9-103f-42d0-bcd4-586b712c0c53'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:33 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:33 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:34 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 1.098s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:34 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:34 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Deleted volume successfully. Sep 03 11:03:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d89951c2-6e40-46d1-97bd-3ea75b711690 tempest-VolumesExtendTest-915657212 None] Lock "cinder-c186c1a3-d6af-477f-bb88-a733135afeb1-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:35 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Flow 'volume_create_manager' (b4789604-b3c3-4d2a-b611-2cd8bb9fed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f48b890-e259-40b6-8939-d1023683e9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f48b890-e259-40b6-8939-d1023683e9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-480827829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233547cb-5fb4-47d3-88b1-6e95c2c07caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecc0e954b6844fe8524e6838ae78b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:36Z,use_quota=True,user_id='7fbe0d32fb2a4ff0917c400a925a1c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0dbffd8-4f74-4790-896e-010f7293a509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0dbffd8-4f74-4790-896e-010f7293a509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da6e2c1-ef68-4f7c-8294-cd2c940a9c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da6e2c1-ef68-4f7c-8294-cd2c940a9c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233547cb-5fb4-47d3-88b1-6e95c2c07caa', 'volume_name': 'volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf5a03d-82bd-4fa8-af60-06436d0cb077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf5a03d-82bd-4fa8-af60-06436d0cb077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22ea87c-1364-43d5-a161-1aa49b24c802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:36 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Volume 233547cb-5fb4-47d3-88b1-6e95c2c07caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa', 'volume_size': 1} Sep 03 11:03:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:38 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" returned: 0 in 6.291s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:38 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:03:38 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Converted 1024.00 MB image at 162.76 MB/s Sep 03 11:03:38 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d is being set with open permissions: ugo+rw Sep 03 11:03:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:38 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d Sep 03 11:03:38 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:39 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" returned: 0 in 0.384s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" released by "_copy_volume_from_snapshot" :: held 8.049s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-b95797e1-e76f-4bdd-8b09-1d17748ee880-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" released by "_create_volume_from_snapshot" :: held 8.123s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.144s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.569s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-76489479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511d94c8-4d33-4bbd-91cb-16a081eee726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9783bc307b54ed68eac0e57ca7e5231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:32Z,use_quota=True,user_id='a16a18c8b4974659898d4faebdabdc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Creating volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:39 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:39 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 1073741824 Sep 03 11:03:39 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc208c41-293d-4d43-8127-71d91feb4029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d', 'volume_size': 2, 'snapshot_id': 'b95797e1-e76f-4bdd-8b09-1d17748ee880'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76a263d-5177-4eba-8771-1b3833dceb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:39 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Volume volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d (7520c96e-1f35-48c6-b4f2-a7900fd08b3d): created successfully Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76a263d-5177-4eba-8771-1b3833dceb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (d34c04ee-551a-4a45-8cb8-2e64545e2950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-772b3bc3-d539-4789-8c99-75298284944e tempest-VolumesSnapshotTestJSON-72310612 None] Created volume successfully. Sep 03 11:03:39 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 1073741824" returned: 0 in 0.452s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:39 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 Sep 03 11:03:39 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:39 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726" returned: 0 in 0.278s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.892s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-480827829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233547cb-5fb4-47d3-88b1-6e95c2c07caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecc0e954b6844fe8524e6838ae78b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:36Z,use_quota=True,user_id='7fbe0d32fb2a4ff0917c400a925a1c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Creating volume 233547cb-5fb4-47d3-88b1-6e95c2c07caa {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:39 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e7ebb6-b64e-4c03-9065-bcde08b40685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511d94c8-4d33-4bbd-91cb-16a081eee726', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ed8467-d406-4ed6-9cce-7bf96be53759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:40 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa 1073741824 Sep 03 11:03:40 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:40 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Volume volume-511d94c8-4d33-4bbd-91cb-16a081eee726 (511d94c8-4d33-4bbd-91cb-16a081eee726): created successfully Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ed8467-d406-4ed6-9cce-7bf96be53759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Flow 'volume_create_manager' (2d5fc6ac-641b-4776-8aaa-11eaf0a3938b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f743fad2-4a16-4a15-9538-dee93b93c51e tempest-SnapshotsActionsTest-1121987663 None] Created volume successfully. Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-7520c96e-1f35-48c6-b4f2-a7900fd08b3d-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-7520c96e-1f35-48c6-b4f2-a7900fd08b3d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[79da664e-fc96-43fb-9165-03fae6fcff15]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:40 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d Sep 03 11:03:40 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:40 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa 1073741824" returned: 0 in 0.590s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:40 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa Sep 03 11:03:40 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:40 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" returned: 0 in 0.547s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:40 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d Sep 03 11:03:40 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:40 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa" returned: 0 in 0.317s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.210s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22ea87c-1364-43d5-a161-1aa49b24c802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235190c1-8aec-4544-bacc-bdea6e6d37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Creating offline snapshot 27585e69-bf33-466a-b8da-b0f3a91b5a71 of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:41 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Volume volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa (233547cb-5fb4-47d3-88b1-6e95c2c07caa): created successfully Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235190c1-8aec-4544-bacc-bdea6e6d37f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Flow 'volume_create_manager' (b4789604-b3c3-4d2a-b611-2cd8bb9fed69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02abc50-fdb8-4ac9-b18a-3c4ade0842dc]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:41 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-90ca7cc1-c0d2-4a2b-95d5-897d9e928320 tempest-VolumesExtendTest-915657212 None] Created volume successfully. Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" returned: 0 in 0.284s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-7520c96e-1f35-48c6-b4f2-a7900fd08b3d" released by "delete_volume" :: held 0.890s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Created reservations ['3ff7a4ee-c732-49d9-8942-c7b7df8d723c', '9cf9129d-fbfa-4727-bc6a-bf4dbeb3242b', '7f97223b-9691-4c3b-9203-7fe5952c6657', 'ecf3ad6a-af77-45a5-b63c-3cbdfe41b102'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:41 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 Sep 03 11:03:41 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:41 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:41 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-b95797e1-e76f-4bdd-8b09-1d17748ee880-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-b95797e1-e76f-4bdd-8b09-1d17748ee880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-aa2ccebe-bb54-436b-aca7-930e380c3696" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-aa2ccebe-bb54-436b-aca7-930e380c3696" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-b95797e1-e76f-4bdd-8b09-1d17748ee880" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-b95797e1-e76f-4bdd-8b09-1d17748ee880" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Deleting offline snapshot b95797e1-e76f-4bdd-8b09-1d17748ee880 of volume aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:03:41 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] snapshot_file for this snap is: volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726" returned: 0 in 0.528s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:41 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[86753446-5bbc-4972-8cb1-b2e06e689961]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:41 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 1G Sep 03 11:03:41 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.361s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Deleted volume successfully. Sep 03 11:03:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1eac854d-e540-493b-9435-50bf6d180a0d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-7520c96e-1f35-48c6-b4f2-a7900fd08b3d-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:41 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 Sep 03 11:03:41 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:42 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880" returned: 0 in 0.532s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa2ccebe-bb54-436b-aca7-930e380c3696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:42 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 1G" returned: 0 in 0.577s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2f02fb-5adc-436f-9c9d-c42fcbb776c6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:42 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:03:42 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:42 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 Sep 03 11:03:42 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:42 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.416s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:42 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 is being set with open permissions: ugo+rw Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:42 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:03:42 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:42 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696" returned: 0 in 0.629s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:42 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 Sep 03 11:03:42 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:42 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.294s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:42 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.info Sep 03 11:03:42 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:43 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880" returned: 0 in 0.395s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:43 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.info" returned: 0 in 0.309s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:43 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.info is being set with open permissions: ugo+rw Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:43 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880 Sep 03 11:03:43 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:43 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.info Sep 03 11:03:43 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:43 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696.b95797e1-e76f-4bdd-8b09-1d17748ee880" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:43 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.info" returned: 0 in 0.298s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-b95797e1-e76f-4bdd-8b09-1d17748ee880" released by "_delete_snapshot" :: held 2.014s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.227s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-aa2ccebe-bb54-436b-aca7-930e380c3696" released by "delete_snapshot" :: held 2.071s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Creating offline snapshot cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 of volume 233547cb-5fb4-47d3-88b1-6e95c2c07caa {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aba52e-1981-492f-8b20-b308292dc245]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-849dc1aa-f04a-45ed-85db-6e67b6d1ce92 tempest-SnapshotsActionsTest-1121987663 None] Create snapshot completed successfully Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Created reservations ['a634f74f-5f21-49ec-9d32-85e9449a12cb', '578bb089-9803-4e58-89a4-237884d4c3c8', '953f0c57-f41b-4aea-be4c-8c868af1c4a9', 'cac162d5-833f-42a1-a060-89154372dbcf'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:43 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa Sep 03 11:03:43 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Delete snapshot completed successfully. Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1b625085-4ea2-476c-984c-ca95dc068c6a tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-b95797e1-e76f-4bdd-8b09-1d17748ee880-delete_snapshot" released by "delete_snapshot" :: held 2.297s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:43 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa" returned: 0 in 0.408s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:44 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 1G Sep 03 11:03:44 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:44 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 1G" returned: 0 in 0.537s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:44 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 Sep 03 11:03:44 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-aa2ccebe-bb54-436b-aca7-930e380c3696-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-aa2ccebe-bb54-436b-aca7-930e380c3696-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-aa2ccebe-bb54-436b-aca7-930e380c3696" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-aa2ccebe-bb54-436b-aca7-930e380c3696" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b058d78-d839-4262-bb75-b2796aeefade]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:44 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4" returned: 0 in 0.412s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:44 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 is being set with open permissions: ugo+rw Sep 03 11:03:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:44 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 Sep 03 11:03:44 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:45 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 Sep 03 11:03:45 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:45 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4" returned: 0 in 0.261s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:45 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.info Sep 03 11:03:45 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:45 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696" returned: 0 in 0.414s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:45 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696 Sep 03 11:03:45 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:45 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.info" returned: 0 in 0.285s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:45 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.info is being set with open permissions: ugo+rw Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:45 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.info Sep 03 11:03:45 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:45 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-aa2ccebe-bb54-436b-aca7-930e380c3696" returned: 0 in 0.296s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-aa2ccebe-bb54-436b-aca7-930e380c3696" released by "delete_volume" :: held 0.776s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Created reservations ['e67a96e4-be6e-403d-aa0f-b3fba9f7af00', '351ed27a-a982-4768-9365-6884719288b1', 'c75c535f-4655-4825-bb74-0731b073caef', '8481d3c4-dd70-4706-bc6b-6458910690e8'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:45 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.info" returned: 0 in 0.269s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:45 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:45 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.102s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Creating offline snapshot bfd21112-c571-45d0-83bb-735145b27eb9 of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:45 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-cdf99387-fb5b-4c61-9c58-b938a23fe6bb tempest-VolumesExtendTest-915657212 None] Create snapshot completed successfully Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb74279-05b3-42ec-ad3a-9d664b991858]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:46 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:46 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.319s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:46 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:46 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Deleted volume successfully. Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d3c846f5-7ac9-4ea7-a3de-4fd743f0115d tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-aa2ccebe-bb54-436b-aca7-930e380c3696-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:46 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.564s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:46 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 1G Sep 03 11:03:46 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (d4f1724d-6048-4e2a-9936-73680516278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4958e88f-8dc9-4116-be15-8293bd612896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4958e88f-8dc9-4116-be15-8293bd612896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-691736119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c3b9ba-144a-446d-8689-13bf2a7e6c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b49c786262046a7a573c1592bcd4be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:47Z,use_quota=True,user_id='edff3bdc6546415d9f34b83ff8e94e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb971f7-ff1a-402f-8baa-f55315a8092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb971f7-ff1a-402f-8baa-f55315a8092e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ce9ff4-2918-43f4-9933-d3b147d381ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ce9ff4-2918-43f4-9933-d3b147d381ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c3b9ba-144a-446d-8689-13bf2a7e6c8c', 'volume_name': 'volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e39b562e-d7b1-4472-9296-86c462f7b97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e39b562e-d7b1-4472-9296-86c462f7b97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a979dd3-3d84-42d1-a61d-c5417a50fded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:46 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Volume 83c3b9ba-144a-446d-8689-13bf2a7e6c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c', 'volume_size': 1} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f816786-7a37-47ac-9bc4-769bcd4163dc tempest-VolumesExtendTest-915657212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:47 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 1G" returned: 0 in 0.632s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:47 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 Sep 03 11:03:47 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:47 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9" returned: 0 in 0.314s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:47 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 is being set with open permissions: ugo+rw Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:47 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 Sep 03 11:03:47 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:47 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.982s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-691736119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c3b9ba-144a-446d-8689-13bf2a7e6c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b49c786262046a7a573c1592bcd4be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:47Z,use_quota=True,user_id='edff3bdc6546415d9f34b83ff8e94e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Creating volume 83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:47 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:03:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:47 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c 1073741824 Sep 03 11:03:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1f58b838-56db-48cd-9019-14810c053ac8 tempest-SnapshotsActionsTest-1121987663 None] Create snapshot completed successfully Sep 03 11:03:47 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:48 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c 1073741824" returned: 0 in 0.479s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:48 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c Sep 03 11:03:48 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:48 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" returned: 0 in 0.252s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f816786-7a37-47ac-9bc4-769bcd4163dc tempest-VolumesExtendTest-915657212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.711s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a979dd3-3d84-42d1-a61d-c5417a50fded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7656c28-4839-4d03-ad4f-3417917c9b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9298af5d-08c0-48bb-b1e2-cfab41bb0036]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f816786-7a37-47ac-9bc4-769bcd4163dc tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:48 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Volume volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c (83c3b9ba-144a-446d-8689-13bf2a7e6c8c): created successfully Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7656c28-4839-4d03-ad4f-3417917c9b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (d4f1724d-6048-4e2a-9936-73680516278b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-43f4e0ec-cadf-4863-8238-7a5f12052f0c tempest-VolumesSnapshotTestJSON-72310612 None] Created volume successfully. Sep 03 11:03:48 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa Sep 03 11:03:48 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:49 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f816786-7a37-47ac-9bc4-769bcd4163dc tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa" returned: 0 in 0.535s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f816786-7a37-47ac-9bc4-769bcd4163dc tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 2G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-bfd21112-c571-45d0-83bb-735145b27eb9-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-bfd21112-c571-45d0-83bb-735145b27eb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-quobyte-bfd21112-c571-45d0-83bb-735145b27eb9" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-bfd21112-c571-45d0-83bb-735145b27eb9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Deleting offline snapshot bfd21112-c571-45d0-83bb-735145b27eb9 of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] snapshot_file for this snap is: volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ca1c1-656a-40af-9e02-a7660038ad2f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f816786-7a37-47ac-9bc4-769bcd4163dc tempest-VolumesExtendTest-915657212 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 2G" returned: 0 in 0.183s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f816786-7a37-47ac-9bc4-769bcd4163dc tempest-VolumesExtendTest-915657212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.776s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.292s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Creating offline snapshot 9112a73a-f52c-4b3a-a86e-766515ee7d07 of volume 83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[851161b0-2d8a-4ad4-b052-0b4431a8d0f2]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:49 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 Sep 03 11:03:49 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7f816786-7a37-47ac-9bc4-769bcd4163dc tempest-VolumesExtendTest-915657212 None] Extend volume completed successfully. Sep 03 11:03:49 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c Sep 03 11:03:49 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:49 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9" returned: 0 in 0.436s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bc15c4-63bd-4c36-aaf1-178faa45375a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:49 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" returned: 0 in 0.412s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:49 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 1G Sep 03 11:03:49 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:49 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:03:49 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:50 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.463s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:50 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 Sep 03 11:03:50 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:50 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 1G" returned: 0 in 0.520s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:50 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 Sep 03 11:03:50 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Acquiring lock "cinder-cc45a91e-d7d0-4bae-a6cd-2663b780ebe4-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Lock "cinder-cc45a91e-d7d0-4bae-a6cd-2663b780ebe4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Acquiring lock "cinder-quobyte-233547cb-5fb4-47d3-88b1-6e95c2c07caa" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Lock "cinder-quobyte-233547cb-5fb4-47d3-88b1-6e95c2c07caa" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Acquiring lock "cinder-quobyte-cc45a91e-d7d0-4bae-a6cd-2663b780ebe4" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Lock "cinder-quobyte-cc45a91e-d7d0-4bae-a6cd-2663b780ebe4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Deleting offline snapshot cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 of volume 233547cb-5fb4-47d3-88b1-6e95c2c07caa {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] snapshot_file for this snap is: volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab3d1a8-d128-4c68-b291-831ce8d30e81]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:50 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 Sep 03 11:03:50 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:50 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07" returned: 0 in 0.399s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:50 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 is being set with open permissions: ugo+rw Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:50 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 Sep 03 11:03:50 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:50 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9" returned: 0 in 0.557s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:50 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9 Sep 03 11:03:50 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:50 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4" returned: 0 in 0.450s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc89e4f-cf3a-4b95-b6c5-62d7b4a63116]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:51 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07" returned: 0 in 0.283s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:51 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.info Sep 03 11:03:51 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:51 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa Sep 03 11:03:51 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:51 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.bfd21112-c571-45d0-83bb-735145b27eb9" returned: 0 in 0.339s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-bfd21112-c571-45d0-83bb-735145b27eb9" released by "_delete_snapshot" :: held 1.945s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" released by "delete_snapshot" :: held 1.973s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Created reservations ['4624c655-f5be-483c-b377-e66336e59d32', '449ea62a-b094-490e-ad66-4afa53e970e1', 'd44b6dc8-863e-416a-87ea-3c0c9df5ff65', 'c1ff96f7-7eb1-4317-84de-ae71de618d5c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:51 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Delete snapshot completed successfully. Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4faa613b-4614-4947-abb8-c9427e22527a tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-bfd21112-c571-45d0-83bb-735145b27eb9-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:51 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.info" returned: 0 in 0.338s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:51 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.info is being set with open permissions: ugo+rw Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:51 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.info Sep 03 11:03:51 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:51 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa" returned: 0 in 0.532s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:51 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 Sep 03 11:03:51 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:51 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.info" returned: 0 in 0.281s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:51 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-162ac9e2-4005-489f-bb82-92f5c4708432 tempest-VolumesSnapshotTestJSON-72310612 None] Create snapshot completed successfully Sep 03 11:03:51 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4" returned: 0 in 0.417s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:51 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4 Sep 03 11:03:51 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:52 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa.cc45a91e-d7d0-4bae-a6cd-2663b780ebe4" returned: 0 in 0.275s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Lock "cinder-quobyte-cc45a91e-d7d0-4bae-a6cd-2663b780ebe4" released by "_delete_snapshot" :: held 1.815s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Lock "cinder-quobyte-233547cb-5fb4-47d3-88b1-6e95c2c07caa" released by "delete_snapshot" :: held 1.845s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Created reservations ['9b885b22-23e4-48d7-ace1-bf5da78357c0', 'a71aa05e-6b3e-487a-8d84-451ed598484c', '96acf210-eb3b-481a-98df-a30919d8430b', '66da3219-7468-40fb-ae22-7b16f5f6deb4'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:52 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Delete snapshot completed successfully. Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-34e9e7f8-2207-4f0d-a8e0-7139ce662354 tempest-VolumesExtendTest-915657212 None] Lock "cinder-cc45a91e-d7d0-4bae-a6cd-2663b780ebe4-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Acquiring lock "cinder-233547cb-5fb4-47d3-88b1-6e95c2c07caa-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Lock "cinder-233547cb-5fb4-47d3-88b1-6e95c2c07caa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Acquiring lock "cinder-quobyte-233547cb-5fb4-47d3-88b1-6e95c2c07caa" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Lock "cinder-quobyte-233547cb-5fb4-47d3-88b1-6e95c2c07caa" acquired by "delete_volume" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[71893cbc-cf5d-47d6-ac53-9cd19b93feea]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:53 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa Sep 03 11:03:53 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (e80a99ef-f9d0-4c05-b65c-6ab27b3ea593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccc9f05-2c5c-4ead-b92c-d730f684d1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccc9f05-2c5c-4ead-b92c-d730f684d1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1199427315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153af8a2-7e51-46a1-a6c1-c213eb775ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b49c786262046a7a573c1592bcd4be3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9112a73a-f52c-4b3a-a86e-766515ee7d07,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:53Z,use_quota=True,user_id='edff3bdc6546415d9f34b83ff8e94e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cac9c9f-5161-44ad-8374-e2471e2acc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cac9c9f-5161-44ad-8374-e2471e2acc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7195f6e-7395-468f-a0cd-e188abaff46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7195f6e-7395-468f-a0cd-e188abaff46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '153af8a2-7e51-46a1-a6c1-c213eb775ae4', 'volume_name': 'volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4', 'volume_size': 1, 'snapshot_id': '9112a73a-f52c-4b3a-a86e-766515ee7d07'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c999d4-f37e-411d-81b9-71abd48518d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c999d4-f37e-411d-81b9-71abd48518d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7870cc39-228f-465a-97d6-73d521062cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:53 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Volume 153af8a2-7e51-46a1-a6c1-c213eb775ae4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4', 'volume_size': 1, 'snapshot_id': '9112a73a-f52c-4b3a-a86e-766515ee7d07'} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Creating offline snapshot 0c5bd62e-0552-493d-beac-0b7826122434 of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:53 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa" returned: 0 in 0.484s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df5da3e-07ff-482f-adf4-0b9f7df4b03a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:53 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa Sep 03 11:03:53 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:53 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:03:53 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:53 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-233547cb-5fb4-47d3-88b1-6e95c2c07caa" returned: 0 in 0.294s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Lock "cinder-quobyte-233547cb-5fb4-47d3-88b1-6e95c2c07caa" released by "delete_volume" :: held 0.885s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Created reservations ['9b09a981-0f02-4aa7-a6cf-ca5ae2fd41ba', 'd456078d-1706-4db3-b94b-e42f027cf828', 'ae581735-774c-4c57-b8e2-f9a9ff8ff3cc', '02b522e8-4b87-4dcc-9f8d-e29c0da8da51'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:03:53 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.475s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:53 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:03:53 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:53 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 1G Sep 03 11:03:53 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:54 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.407s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:54 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:03:54 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Deleted volume successfully. Sep 03 11:03:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-31aa84f0-0fb5-429c-93e8-3ba980d6e22c tempest-VolumesExtendTest-915657212 None] Lock "cinder-233547cb-5fb4-47d3-88b1-6e95c2c07caa-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:03:54 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 1G" returned: 0 in 0.596s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:54 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 Sep 03 11:03:54 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:54 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434" returned: 0 in 0.336s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:54 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 is being set with open permissions: ugo+rw Sep 03 11:03:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:54 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 Sep 03 11:03:54 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:55 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434" returned: 0 in 0.304s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.798s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-9112a73a-f52c-4b3a-a86e-766515ee7d07-153af8a2-7e51-46a1-a6c1-c213eb775ae4" by "_create_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-9112a73a-f52c-4b3a-a86e-766515ee7d07-153af8a2-7e51-46a1-a6c1-c213eb775ae4" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Creating volume 153af8a2-7e51-46a1-a6c1-c213eb775ae4 from snapshot 9112a73a-f52c-4b3a-a86e-766515ee7d07 {{(pid=86603) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-153af8a2-7e51-46a1-a6c1-c213eb775ae4" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6832385a-4ef8-43dd-ba53-3fc0be72aa3a tempest-SnapshotsActionsTest-1121987663 None] Create snapshot completed successfully Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-153af8a2-7e51-46a1-a6c1-c213eb775ae4" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] snapshot: 9112a73a-f52c-4b3a-a86e-766515ee7d07, volume: 153af8a2-7e51-46a1-a6c1-c213eb775ae4, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3be6ee-2ba4-4889-98e3-51cfe1bc99c1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:55 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 Sep 03 11:03:55 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:55 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07" returned: 0 in 0.410s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e90bf4-02af-4f43-b0c2-e76b1b1990e9]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:55 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c Sep 03 11:03:55 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:56 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" returned: 0 in 0.445s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:56 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 Sep 03 11:03:56 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-0c5bd62e-0552-493d-beac-0b7826122434-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-0c5bd62e-0552-493d-beac-0b7826122434-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-quobyte-0c5bd62e-0552-493d-beac-0b7826122434" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-0c5bd62e-0552-493d-beac-0b7826122434" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Deleting offline snapshot 0c5bd62e-0552-493d-beac-0b7826122434 of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] snapshot_file for this snap is: volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e0218-3464-498d-bd79-fc22afd7b4f1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:56 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 Sep 03 11:03:56 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:57 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434" returned: 0 in 0.794s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:57 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb20aa-da0f-46d2-8bda-d627f8709689]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:03:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:57 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:03:57 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (91fcbd01-b00c-49ab-b896-4920f06e81a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ddbe22-6558-4799-b1ae-ab2ac250ed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ddbe22-6558-4799-b1ae-ab2ac250ed42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-445683963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cc6a6e-cfd3-4750-b366-0af2834a66a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:58Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595d7f5-15f8-4e80-a127-61cd72b076fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5595d7f5-15f8-4e80-a127-61cd72b076fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafae139-8df4-4091-9d3c-b1c880ef7926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafae139-8df4-4091-9d3c-b1c880ef7926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4cc6a6e-cfd3-4750-b366-0af2834a66a0', 'volume_name': 'volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f9a7df-8fba-4845-b1ab-3a7999df2076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f9a7df-8fba-4845-b1ab-3a7999df2076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0398f909-a500-41bd-896d-8a56b5918c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:03:58 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Volume f4cc6a6e-cfd3-4750-b366-0af2834a66a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0', 'volume_size': 1} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:03:58 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 1.552s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:03:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:03:59 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 Sep 03 11:03:59 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:00 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434" returned: 0 in 1.117s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:00 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434 Sep 03 11:04:00 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:00 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.0c5bd62e-0552-493d-beac-0b7826122434" returned: 0 in 0.752s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-0c5bd62e-0552-493d-beac-0b7826122434" released by "_delete_snapshot" :: held 4.489s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" released by "delete_snapshot" :: held 4.532s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:01 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Created reservations ['233abebd-6bd4-4a34-806a-e5a574c548f7', '423fe067-85b6-4ff6-86e6-36e71bdfe8bd', '58ea2410-b05f-4b45-a611-895b25b4794c', '3e42ac6d-5933-4423-b03f-e1a5c9550b83'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Delete snapshot completed successfully. Sep 03 11:04:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a9b0bc2a-4584-4193-a568-abc9de4592ee tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-0c5bd62e-0552-493d-beac-0b7826122434-delete_snapshot" released by "delete_snapshot" :: held 5.001s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:02 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4" returned: 0 in 6.709s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:02 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:04:02 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Converted 1024.00 MB image at 152.58 MB/s Sep 03 11:04:02 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 is being set with open permissions: ugo+rw Sep 03 11:04:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:02 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 Sep 03 11:04:02 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:03 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4" returned: 0 in 0.277s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-153af8a2-7e51-46a1-a6c1-c213eb775ae4" released by "_copy_volume_from_snapshot" :: held 7.951s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-9112a73a-f52c-4b3a-a86e-766515ee7d07-153af8a2-7e51-46a1-a6c1-c213eb775ae4" released by "_create_volume_from_snapshot" :: held 8.040s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.070s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.683s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-445683963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cc6a6e-cfd3-4750-b366-0af2834a66a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:03:58Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Creating volume f4cc6a6e-cfd3-4750-b366-0af2834a66a0 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:03 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:03 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 1073741824 Sep 03 11:04:03 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7870cc39-228f-465a-97d6-73d521062cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4', 'volume_size': 1, 'snapshot_id': '9112a73a-f52c-4b3a-a86e-766515ee7d07'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6d3dd2-4dc7-43a1-ae25-9f99dd8343a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:03 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Volume volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 (153af8a2-7e51-46a1-a6c1-c213eb775ae4): created successfully Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6d3dd2-4dc7-43a1-ae25-9f99dd8343a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Flow 'volume_create_manager' (e80a99ef-f9d0-4c05-b65c-6ab27b3ea593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e1f4ee44-1639-410d-acd6-72daa10c1cab tempest-VolumesSnapshotTestJSON-72310612 None] Created volume successfully. Sep 03 11:04:03 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 1073741824" returned: 0 in 0.441s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:03 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 Sep 03 11:04:03 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:04 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0" returned: 0 in 0.286s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.055s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0398f909-a500-41bd-896d-8a56b5918c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb55ddd-52dd-4a7f-a42f-a6033e7ef5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Creating offline snapshot 67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:04:04 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Volume volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 (f4cc6a6e-cfd3-4750-b366-0af2834a66a0): created successfully Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb55ddd-52dd-4a7f-a42f-a6033e7ef5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (91fcbd01-b00c-49ab-b896-4920f06e81a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efcf5e4-537f-4594-9c5b-b4041abe9c30]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f4ca1075-b1b8-4a32-ad2d-7e36e375c0bb tempest-VolumesGetTest-1339138920 None] Created volume successfully. Sep 03 11:04:04 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:04:04 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-153af8a2-7e51-46a1-a6c1-c213eb775ae4-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-153af8a2-7e51-46a1-a6c1-c213eb775ae4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-153af8a2-7e51-46a1-a6c1-c213eb775ae4" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-153af8a2-7e51-46a1-a6c1-c213eb775ae4" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6951267c-b96e-4804-b299-ce716605908a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:04 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 Sep 03 11:04:04 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:04 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.495s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:04 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 1G Sep 03 11:04:04 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:04 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4" returned: 0 in 0.528s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:05 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4 Sep 03 11:04:05 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:05 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 1G" returned: 0 in 0.985s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:05 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 Sep 03 11:04:05 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:05 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-153af8a2-7e51-46a1-a6c1-c213eb775ae4" returned: 0 in 0.748s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-153af8a2-7e51-46a1-a6c1-c213eb775ae4" released by "delete_volume" :: held 1.362s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Created reservations ['f017101a-6ba2-4090-af6a-015bf03d7dd0', 'f5e922f6-4e02-475d-9877-65bb0fc3103c', '4e78570a-87c5-402b-bacf-adf34739156d', '75730938-8bb0-4ee5-8904-676a9bf149b4'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (a6781f15-ebb0-49da-9818-699009019007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57685d15-3b4a-4d92-9b16-8dff274a14dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57685d15-3b4a-4d92-9b16-8dff274a14dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2044252107',display_name='tempest-VolumesGetTest-Volume-883595378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f93795-f54a-4231-a391-6d283dfd7cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:06Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d32c89-c3b5-4141-9a33-5eaa4acfd09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d32c89-c3b5-4141-9a33-5eaa4acfd09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c5c8e2-9df4-49f1-ad84-0f90338265ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c5c8e2-9df4-49f1-ad84-0f90338265ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f93795-f54a-4231-a391-6d283dfd7cdf', 'volume_name': 'volume-12f93795-f54a-4231-a391-6d283dfd7cdf', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97122250-3c1e-4269-9364-41cd4506c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97122250-3c1e-4269-9364-41cd4506c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ea9d8d-1d45-46b1-81ea-334c98caffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:06 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Volume 12f93795-f54a-4231-a391-6d283dfd7cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f93795-f54a-4231-a391-6d283dfd7cdf', 'volume_size': 1} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:06 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:06 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:06 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10" returned: 0 in 0.797s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:06 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 is being set with open permissions: ugo+rw Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:06 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 Sep 03 11:04:06 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:06 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.463s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:06 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:06 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Deleted volume successfully. Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10" returned: 0 in 0.424s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-9112a73a-f52c-4b3a-a86e-766515ee7d07-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad7c2aa2-da2c-4662-a0cc-641ae7dd1139 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-153af8a2-7e51-46a1-a6c1-c213eb775ae4-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.953s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-9112a73a-f52c-4b3a-a86e-766515ee7d07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.111s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2044252107',display_name='tempest-VolumesGetTest-Volume-883595378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f93795-f54a-4231-a391-6d283dfd7cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:06Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Creating volume 12f93795-f54a-4231-a391-6d283dfd7cdf {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:07 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:07 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf 1073741824 Sep 03 11:04:07 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" acquired by "delete_snapshot" :: waited 0.140s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-9112a73a-f52c-4b3a-a86e-766515ee7d07" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:07 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-fe39d48b-f767-4a95-b559-4b1d34aea85c tempest-SnapshotsActionsTest-1121987663 None] Create snapshot completed successfully Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-9112a73a-f52c-4b3a-a86e-766515ee7d07" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Deleting offline snapshot 9112a73a-f52c-4b3a-a86e-766515ee7d07 of volume 83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] snapshot_file for this snap is: volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f67281b-08dc-411d-8db8-005280e9dd95]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:07 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 Sep 03 11:04:07 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-67aaa2e4-ad46-4cd4-ada9-0e36abc10a10-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-67aaa2e4-ad46-4cd4-ada9-0e36abc10a10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-quobyte-67aaa2e4-ad46-4cd4-ada9-0e36abc10a10" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-67aaa2e4-ad46-4cd4-ada9-0e36abc10a10" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Deleting offline snapshot 67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] snapshot_file for this snap is: volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cb7a39-f76c-41fb-b678-14cb1aef3450]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:07 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07" returned: 0 in 0.478s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:07 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf 1073741824" returned: 0 in 0.719s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d812374-8a6f-4a1a-8c9c-b32f9e9e9735]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:07 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 Sep 03 11:04:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:07 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:07 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf Sep 03 11:04:07 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:07 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c Sep 03 11:04:07 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:08 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10" returned: 0 in 0.455s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:08 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf" returned: 0 in 0.363s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[330af837-5c05-4ac2-8a78-68424337cdea]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ea9d8d-1d45-46b1-81ea-334c98caffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f93795-f54a-4231-a391-6d283dfd7cdf', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d55600b-c016-4ec8-bde1-4132b0d02819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:08 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Volume volume-12f93795-f54a-4231-a391-6d283dfd7cdf (12f93795-f54a-4231-a391-6d283dfd7cdf): created successfully Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d55600b-c016-4ec8-bde1-4132b0d02819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (a6781f15-ebb0-49da-9818-699009019007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a508ecf1-7194-4f74-b62e-135abef53ffc tempest-VolumesGetTest-1339138920 None] Created volume successfully. Sep 03 11:04:08 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:04:08 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:08 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" returned: 0 in 0.715s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:08 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 Sep 03 11:04:08 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:08 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.537s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:08 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 Sep 03 11:04:08 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:08 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07" returned: 0 in 0.457s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:09 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07 Sep 03 11:04:09 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:09 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10" returned: 0 in 0.533s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:09 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c.9112a73a-f52c-4b3a-a86e-766515ee7d07" returned: 0 in 0.373s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:09 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10 Sep 03 11:04:09 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-9112a73a-f52c-4b3a-a86e-766515ee7d07" released by "_delete_snapshot" :: held 2.203s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" released by "delete_snapshot" :: held 2.248s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Created reservations ['f4a35ef2-c51a-4d0a-a7ea-05acc8d3e853', '5f1a8333-a2cf-4c5c-8128-17421516eda0', 'e9d5caca-c70f-479a-b0aa-34e0ea183cff', '882b01c2-7c31-4a8d-9615-0e309142cfbe'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Delete snapshot completed successfully. Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-333d234c-41ce-4edf-8246-cb20a12c852c tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-9112a73a-f52c-4b3a-a86e-766515ee7d07-delete_snapshot" released by "delete_snapshot" :: held 2.649s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:09 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-12f93795-f54a-4231-a391-6d283dfd7cdf-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.67aaa2e4-ad46-4cd4-ada9-0e36abc10a10" returned: 0 in 0.436s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Lock "cinder-12f93795-f54a-4231-a391-6d283dfd7cdf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-67aaa2e4-ad46-4cd4-ada9-0e36abc10a10" released by "_delete_snapshot" :: held 2.104s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" released by "delete_snapshot" :: held 2.152s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-quobyte-12f93795-f54a-4231-a391-6d283dfd7cdf" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-12f93795-f54a-4231-a391-6d283dfd7cdf" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a95d97c-0f1e-43e8-9a1d-4d32fb67ec50]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Created reservations ['a20003d0-63e1-4f59-ae17-4f70d8f1bdbd', 'f5467976-60bc-4361-a670-101184ec3044', '896f2b3f-9543-4e53-865c-1b7278ef5871', 'b98a1925-01d3-4ab4-940e-b017a9fade9e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:10 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf Sep 03 11:04:10 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Delete snapshot completed successfully. Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a6047deb-98eb-4057-8e90-036abbec9cbb tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-67aaa2e4-ad46-4cd4-ada9-0e36abc10a10-delete_snapshot" released by "delete_snapshot" :: held 2.499s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-83c3b9ba-144a-446d-8689-13bf2a7e6c8c-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-83c3b9ba-144a-446d-8689-13bf2a7e6c8c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc56e3-e489-4e19-8e28-079b2b2d272c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:10 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf" returned: 0 in 0.588s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:10 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf Sep 03 11:04:10 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:10 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c Sep 03 11:04:10 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:10 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-12f93795-f54a-4231-a391-6d283dfd7cdf" returned: 0 in 0.318s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-12f93795-f54a-4231-a391-6d283dfd7cdf" released by "delete_volume" :: held 0.997s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Created reservations ['7951ded1-e62c-4fe9-83ba-0498adc15edb', '6093eb50-9c0a-47cd-8e23-1677c42bd9d4', '2270dfda-9eb9-4961-9993-61463f89cf8e', 'd80d43c0-0ecd-48fd-8f5c-66cf48da2c3e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:10 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" returned: 0 in 0.532s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:11 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:11 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:11 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:11 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:11 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" returned: 0 in 0.391s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=204,cinder:DELETE=8,cinder:SELECT=187,cinder:INSERT=50 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-83c3b9ba-144a-446d-8689-13bf2a7e6c8c" released by "delete_volume" :: held 1.023s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Creating offline snapshot a8518d8f-e37d-46b6-99cb-16b91df9b47e of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:04:11 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.439s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaae858-f5a9-4740-9f98-6125f3a55f7d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Deleted volume successfully. Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-86009502-968a-45c7-87a2-2be12cea0c9e tempest-VolumesGetTest-1339138920 None] Lock "cinder-12f93795-f54a-4231-a391-6d283dfd7cdf-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Created reservations ['13e168b1-4e1e-4e53-87e8-89dfc541e166', 'aa87ffcb-6d07-4790-bffb-d1737642004d', 'b84f9023-6ae8-4fa1-9a21-306af4c8c8d7', '6c5b9b1a-1b74-4caa-b697-c7943d0f9a36'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:11 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:11 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:11 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:11 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:11 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.400s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:11 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.289s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:11 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:11 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e 1G Sep 03 11:04:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Deleted volume successfully. Sep 03 11:04:11 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-55c6a2f3-42c9-4ae5-b8e6-32a07ee91997 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-83c3b9ba-144a-446d-8689-13bf2a7e6c8c-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-f4cc6a6e-cfd3-4750-b366-0af2834a66a0-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Lock "cinder-f4cc6a6e-cfd3-4750-b366-0af2834a66a0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-quobyte-f4cc6a6e-cfd3-4750-b366-0af2834a66a0" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-f4cc6a6e-cfd3-4750-b366-0af2834a66a0" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c455594-881a-419f-84d2-2a7009a05498]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:12 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 Sep 03 11:04:12 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:12 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e 1G" returned: 0 in 0.497s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:12 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e Sep 03 11:04:12 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:12 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:12 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0 Sep 03 11:04:12 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-80c698c5-5811-441e-808d-f5a85df15735-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-80c698c5-5811-441e-808d-f5a85df15735-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:12 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e" returned: 0 in 0.378s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:12 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e is being set with open permissions: ugo+rw Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:12 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e Sep 03 11:04:12 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "cinder-quobyte-80c698c5-5811-441e-808d-f5a85df15735" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-80c698c5-5811-441e-808d-f5a85df15735" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc2aba8-ab6c-43de-a667-eb31eed590fd]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:13 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f4cc6a6e-cfd3-4750-b366-0af2834a66a0" returned: 0 in 0.350s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-f4cc6a6e-cfd3-4750-b366-0af2834a66a0" released by "delete_volume" :: held 0.823s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:13 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 Sep 03 11:04:13 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:13 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e" returned: 0 in 0.312s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.725s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Created reservations ['0118af86-8b42-4dde-89a8-e4dcfa3b2822', '11cd6439-bce4-4b77-8397-741862af7feb', 'ec2583bc-df78-4d99-9c7a-bf8d0df63245', '32e82b72-6f8f-4ddd-9222-a25c5a4471db'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1f0f8b1d-de22-4d49-9df7-1039f645cfdd tempest-SnapshotsActionsTest-1121987663 None] Create snapshot completed successfully Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:13 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:13 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:13 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735" returned: 0 in 0.452s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:13 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735 Sep 03 11:04:13 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-a8518d8f-e37d-46b6-99cb-16b91df9b47e-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-a8518d8f-e37d-46b6-99cb-16b91df9b47e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Acquiring lock "cinder-quobyte-a8518d8f-e37d-46b6-99cb-16b91df9b47e" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:13 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-a8518d8f-e37d-46b6-99cb-16b91df9b47e" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Deleting offline snapshot a8518d8f-e37d-46b6-99cb-16b91df9b47e of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:04:13 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] snapshot_file for this snap is: volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.551s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-80c698c5-5811-441e-808d-f5a85df15735" returned: 0 in 0.439s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f7ac25-0212-468f-981a-f7273abc5d5a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Deleted volume successfully. Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-quobyte-80c698c5-5811-441e-808d-f5a85df15735" released by "delete_volume" :: held 1.017s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc7ec10e-1cc2-4e3c-aff7-6b01fae8155d tempest-VolumesGetTest-1339138920 None] Lock "cinder-f4cc6a6e-cfd3-4750-b366-0af2834a66a0-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Created reservations ['6bcce9d4-6cc0-4b83-b311-c7e7c26f5db6', 'bd665310-ce00-413a-ae5e-ab83fbe2a01a', '0c6fe801-8b45-4370-b264-4df9e0a63229', '492da350-e11a-4846-8bee-5db64e54c48a'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:14 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e Sep 03 11:04:14 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:14 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:14 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (188d1775-3775-48a1-8ffe-56bdc886f38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fed33d6-5760-4433-83eb-c04fe5a5bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fed33d6-5760-4433-83eb-c04fe5a5bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-464335576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcf093a-61c5-4adc-9aff-838bd692e073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:14Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f63aed1-b529-4928-ad4a-280e2d6298d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f63aed1-b529-4928-ad4a-280e2d6298d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48e92e2-372b-4e09-8e8f-80bd1dbb3aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48e92e2-372b-4e09-8e8f-80bd1dbb3aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbcf093a-61c5-4adc-9aff-838bd692e073', 'volume_name': 'volume-cbcf093a-61c5-4adc-9aff-838bd692e073', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4deb3d2-d7d2-4629-aa51-cd2367a60171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4deb3d2-d7d2-4629-aa51-cd2367a60171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6381b2-8c1d-4058-a0c7-cd8eed3691c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:14 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Volume cbcf093a-61c5-4adc-9aff-838bd692e073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbcf093a-61c5-4adc-9aff-838bd692e073', 'volume_size': 1} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-464335576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcf093a-61c5-4adc-9aff-838bd692e073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:14Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Creating volume cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:14 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:14 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e" returned: 0 in 0.558s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:14 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 1073741824 Sep 03 11:04:14 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[47815f41-2546-4df7-81de-e306810b3aa9]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:14 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.336s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Deleted volume successfully. Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d4654994-7e90-43d7-bb7a-7c3318faec14 tempest-VolumesSnapshotTestJSON-72310612 None] Lock "cinder-80c698c5-5811-441e-808d-f5a85df15735-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:14 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:04:14 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:14 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 1073741824" returned: 0 in 0.503s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:14 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.433s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:14 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e Sep 03 11:04:14 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:15 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 Sep 03 11:04:15 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:15 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073" returned: 0 in 0.324s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6381b2-8c1d-4058-a0c7-cd8eed3691c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbcf093a-61c5-4adc-9aff-838bd692e073', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c0e247-be37-403c-ab0a-6cb4626cac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:15 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Volume volume-cbcf093a-61c5-4adc-9aff-838bd692e073 (cbcf093a-61c5-4adc-9aff-838bd692e073): created successfully Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c0e247-be37-403c-ab0a-6cb4626cac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (188d1775-3775-48a1-8ffe-56bdc886f38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:15 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e" returned: 0 in 0.440s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2935bcf2-5660-4fcb-b8ff-9f7a842ed140 tempest-VolumesGetTest-1339138920 None] Created volume successfully. Sep 03 11:04:15 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e Sep 03 11:04:15 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:15 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.a8518d8f-e37d-46b6-99cb-16b91df9b47e" returned: 0 in 0.264s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-a8518d8f-e37d-46b6-99cb-16b91df9b47e" released by "_delete_snapshot" :: held 1.855s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" released by "delete_snapshot" :: held 1.906s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Created reservations ['0e7490c7-eec1-45a6-90c9-5f56a7ecc6a8', '4218f049-b9b5-4e20-bd54-b6c9d71862ce', '895b5854-6eb5-47f6-8864-514fc0973e02', '40a26e72-f55f-4b53-8a8f-56ecd82b22ae'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Delete snapshot completed successfully. Sep 03 11:04:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7ffd5e55-c6e9-4557-b561-08a424dad0d7 tempest-SnapshotsActionsTest-1142980554 None] Lock "cinder-a8518d8f-e37d-46b6-99cb-16b91df9b47e-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "cinder-27585e69-bf33-466a-b8da-b0f3a91b5a71-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-27585e69-bf33-466a-b8da-b0f3a91b5a71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "cinder-quobyte-27585e69-bf33-466a-b8da-b0f3a91b5a71" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-quobyte-27585e69-bf33-466a-b8da-b0f3a91b5a71" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Deleting offline snapshot 27585e69-bf33-466a-b8da-b0f3a91b5a71 of volume 511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] snapshot_file for this snap is: volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe40d96-f38a-4040-b1b8-1a905b5b7662]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:16 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:04:16 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:17 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.495s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-511d94c8-4d33-4bbd-91cb-16a081eee726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59d47b2-9416-4aa4-9c2a-b34e1ce64a99]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (710ae6a5-1b21-4e1f-8ae4-004b3b63c97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadc1e3c-22a9-4b0d-b855-67c8b1c1610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadc1e3c-22a9-4b0d-b855-67c8b1c1610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-661588366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29e41ae-8423-4971-b508-4faa60c56a2e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cbcf093a-61c5-4adc-9aff-838bd692e073,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:17Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd757b80-06de-4f1f-8131-e48b53f0b855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd757b80-06de-4f1f-8131-e48b53f0b855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1981c211-a9cc-4b04-981d-a92701e4bc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1981c211-a9cc-4b04-981d-a92701e4bc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c29e41ae-8423-4971-b508-4faa60c56a2e', 'volume_name': 'volume-c29e41ae-8423-4971-b508-4faa60c56a2e', 'volume_size': 1, 'source_volid': 'cbcf093a-61c5-4adc-9aff-838bd692e073', 'source_volstatus': 'available'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6069f9e2-25c7-41b1-a727-be3321ccca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6069f9e2-25c7-41b1-a727-be3321ccca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa6c1b9-d76a-4283-9700-cf56bf7111f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:17 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Volume c29e41ae-8423-4971-b508-4faa60c56a2e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c29e41ae-8423-4971-b508-4faa60c56a2e', 'volume_size': 1, 'source_volid': 'cbcf093a-61c5-4adc-9aff-838bd692e073', 'source_volstatus': 'available'} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:17 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Cloning volume cbcf093a-61c5-4adc-9aff-838bd692e073 to volume c29e41ae-8423-4971-b508-4faa60c56a2e Sep 03 11:04:17 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 Sep 03 11:04:17 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Creating offline snapshot b04400f6-3ea5-40ce-9c3b-365f969cd896 of volume cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2b638f-9cc4-4f7b-9023-d297a555c92d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:17 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 Sep 03 11:04:17 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:17 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726" returned: 0 in 0.528s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:17 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:04:17 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:18 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073" returned: 0 in 0.560s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:18 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 1G Sep 03 11:04:18 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:18 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.424s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:18 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71 Sep 03 11:04:18 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:18 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 1G" returned: 0 in 0.519s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbcf093a-61c5-4adc-9aff-838bd692e073 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:18 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726.27585e69-bf33-466a-b8da-b0f3a91b5a71" returned: 0 in 0.350s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:18 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbcf093a-61c5-4adc-9aff-838bd692e073 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 Sep 03 11:04:18 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-quobyte-27585e69-bf33-466a-b8da-b0f3a91b5a71" released by "_delete_snapshot" :: held 1.975s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" released by "delete_snapshot" :: held 2.010s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Created reservations ['0cd753a1-11b6-4c35-8282-413aa4be866a', 'e272bd94-3b73-42dd-9178-0b79c80335f2', '11c59e5f-65c7-4a16-a0b7-7a5b1d01cee1', '568539f7-bb1a-4371-890a-f790477d460e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Delete snapshot completed successfully. Sep 03 11:04:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-822e0336-498f-4d8c-8150-02c9f780856e tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-27585e69-bf33-466a-b8da-b0f3a91b5a71-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:19 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbcf093a-61c5-4adc-9aff-838bd692e073 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896" returned: 0 in 0.516s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:19 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 is being set with open permissions: ugo+rw Sep 03 11:04:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:19 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 Sep 03 11:04:19 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:19 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896" returned: 0 in 0.301s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:19 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.info Sep 03 11:04:19 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:19 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.info" returned: 0 in 0.292s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:19 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.info is being set with open permissions: ugo+rw Sep 03 11:04:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:19 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.info Sep 03 11:04:19 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:19 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "cinder-511d94c8-4d33-4bbd-91cb-16a081eee726-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:19 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-511d94c8-4d33-4bbd-91cb-16a081eee726-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:20 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.info" returned: 0 in 0.337s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-quobyte-c29e41ae-8423-4971-b508-4faa60c56a2e" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-c29e41ae-8423-4971-b508-4faa60c56a2e" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] snapshot: b04400f6-3ea5-40ce-9c3b-365f969cd896, volume: c29e41ae-8423-4971-b508-4faa60c56a2e, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" acquired by "delete_volume" :: waited 0.071s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc95b66-6193-4e89-9cda-0ba85b8f82c3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4bc65b-52eb-4e1b-bec9-9ca16fd38ec2]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:20 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 Sep 03 11:04:20 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:20 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 Sep 03 11:04:20 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:20 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896" returned: 0 in 0.418s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbcf093a-61c5-4adc-9aff-838bd692e073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:20 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8784e2-1f5f-483f-b0f6-5bf2acd4d0d7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:20 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726 Sep 03 11:04:20 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:20 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 Sep 03 11:04:20 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:20 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-511d94c8-4d33-4bbd-91cb-16a081eee726" returned: 0 in 0.295s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-quobyte-511d94c8-4d33-4bbd-91cb-16a081eee726" released by "delete_volume" :: held 0.798s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Created reservations ['b3e3edbd-887c-4957-aef6-1dd4363d380f', '0b991f09-65ba-4609-9314-7a80a07f60f9', '43ee8e72-bec9-4b76-a1f0-e5952b32257e', 'ad35ed4f-1d31-4fe0-8d41-4c8925c64608'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:21 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073" returned: 0 in 0.458s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:21 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e Sep 03 11:04:21 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:21 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:21 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:21 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.292s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:21 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Deleted volume successfully. Sep 03 11:04:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-87876693-adde-42cf-bb96-d19efcde45fc tempest-SnapshotsActionsTest-1121987663 None] Lock "cinder-511d94c8-4d33-4bbd-91cb-16a081eee726-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:23 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:23 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:23 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.485s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:04:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:04:26 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e" returned: 0 in 5.525s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:26 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:04:26 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Converted 1024.00 MB image at 185.31 MB/s Sep 03 11:04:26 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e is being set with open permissions: ugo+rw Sep 03 11:04:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:26 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e Sep 03 11:04:26 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:26 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=165,cinder:INSERT=65,cinder:UPDATE=199,cinder:DELETE=21 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:04:26 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e" returned: 0 in 0.295s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:26 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Flow 'volume_create_manager' (41d8405f-ed29-4abe-9d2a-0152d3e88435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6138f669-692e-46ba-8a5b-47035bf5acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-c29e41ae-8423-4971-b508-4faa60c56a2e" released by "_copy_volume_from_snapshot" :: held 6.865s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-quobyte-b04400f6-3ea5-40ce-9c3b-365f969cd896" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6138f669-692e-46ba-8a5b-47035bf5acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2015482952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d3a588-4a25-4edb-af69-edfb0f186839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d50e1b052f485b8c14152c2d4db414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:27Z,use_quota=True,user_id='379781dbcb084af69b5f16ef38125751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4ffb00-8044-44e6-bffd-4a415b089ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4ffb00-8044-44e6-bffd-4a415b089ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d929ed08-e64b-41a8-831f-f02b82783f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d929ed08-e64b-41a8-831f-f02b82783f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3d3a588-4a25-4edb-af69-edfb0f186839', 'volume_name': 'volume-d3d3a588-4a25-4edb-af69-edfb0f186839', 'volume_size': 2}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ee0e1d-6266-4d5e-acc3-f175cf51bb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ee0e1d-6266-4d5e-acc3-f175cf51bb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47c3833-61f4-434f-b18a-d0793f38e11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:27 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Volume d3d3a588-4a25-4edb-af69-edfb0f186839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3d3a588-4a25-4edb-af69-edfb0f186839', 'volume_size': 2} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-b04400f6-3ea5-40ce-9c3b-365f969cd896" acquired by "_delete_snapshot" :: waited 0.089s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Deleting offline snapshot b04400f6-3ea5-40ce-9c3b-365f969cd896 of volume cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] snapshot_file for this snap is: volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dc1cb9-9af7-4020-9b17-50701e0085e3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:27 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 Sep 03 11:04:27 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:27 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896" returned: 0 in 0.478s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbcf093a-61c5-4adc-9aff-838bd692e073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b094d797-7492-420d-8b12-e6dcb840dcf4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:27 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 Sep 03 11:04:27 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:28 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073" returned: 0 in 0.591s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:28 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 Sep 03 11:04:28 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:28 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896" returned: 0 in 0.443s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:28 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896 Sep 03 11:04:28 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:28 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073.b04400f6-3ea5-40ce-9c3b-365f969cd896" returned: 0 in 0.280s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-b04400f6-3ea5-40ce-9c3b-365f969cd896" released by "_delete_snapshot" :: held 1.914s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.630s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.979s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2015482952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d3a588-4a25-4edb-af69-edfb0f186839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d50e1b052f485b8c14152c2d4db414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:27Z,use_quota=True,user_id='379781dbcb084af69b5f16ef38125751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Creating volume d3d3a588-4a25-4edb-af69-edfb0f186839 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:29 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 2147483648 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa6c1b9-d76a-4283-9700-cf56bf7111f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29e41ae-8423-4971-b508-4faa60c56a2e', 'volume_size': 1, 'source_volid': 'cbcf093a-61c5-4adc-9aff-838bd692e073', 'source_volstatus': 'available'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:29 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 2147483648 Sep 03 11:04:29 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f020118-ddba-4bc3-b156-10b8784f6f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:29 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Volume volume-c29e41ae-8423-4971-b508-4faa60c56a2e (c29e41ae-8423-4971-b508-4faa60c56a2e): created successfully Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f020118-ddba-4bc3-b156-10b8784f6f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (710ae6a5-1b21-4e1f-8ae4-004b3b63c97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:29 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-43edf804-1215-441a-acd2-a865590d5019 tempest-VolumesGetTest-1339138920 None] Created volume successfully. Sep 03 11:04:29 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 2147483648" returned: 0 in 0.576s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:29 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 Sep 03 11:04:29 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:29 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839" returned: 0 in 0.293s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47c3833-61f4-434f-b18a-d0793f38e11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d3a588-4a25-4edb-af69-edfb0f186839', 'volume_size': 2}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2999f2dc-0f77-4af8-8456-09a38b65146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:30 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Volume volume-d3d3a588-4a25-4edb-af69-edfb0f186839 (d3d3a588-4a25-4edb-af69-edfb0f186839): created successfully Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2999f2dc-0f77-4af8-8456-09a38b65146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Flow 'volume_create_manager' (41d8405f-ed29-4abe-9d2a-0152d3e88435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:30 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c8029cc3-a840-4125-aee3-67ec83fd7510 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Created volume successfully. Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (abe7dc2c-2fd3-43d7-ac6f-f1f563e51cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71119248-e74b-4811-a855-86c62e4f5f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71119248-e74b-4811-a855-86c62e4f5f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1375079536',display_name='tempest-VolumesGetTest-Volume-1587112509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bccdf0-b862-431e-9f4d-6399056f64ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:30Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f16981-bf63-468c-9e52-26df15f2594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f16981-bf63-468c-9e52-26df15f2594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28abfb73-7314-48f8-967a-24769e4a1661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28abfb73-7314-48f8-967a-24769e4a1661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09bccdf0-b862-431e-9f4d-6399056f64ba', 'volume_name': 'volume-09bccdf0-b862-431e-9f4d-6399056f64ba', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f23f30-d077-4dfa-8cac-f7121571adf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f23f30-d077-4dfa-8cac-f7121571adf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54b3f80-ab37-4145-9f77-dd30637c5c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:30 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Volume 09bccdf0-b862-431e-9f4d-6399056f64ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09bccdf0-b862-431e-9f4d-6399056f64ba', 'volume_size': 1} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1375079536',display_name='tempest-VolumesGetTest-Volume-1587112509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bccdf0-b862-431e-9f4d-6399056f64ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:30Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Creating volume 09bccdf0-b862-431e-9f4d-6399056f64ba {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:30 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:30 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba 1073741824 Sep 03 11:04:30 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:30 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba 1073741824" returned: 0 in 0.522s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:31 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba Sep 03 11:04:31 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:31 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba" returned: 0 in 0.284s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54b3f80-ab37-4145-9f77-dd30637c5c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09bccdf0-b862-431e-9f4d-6399056f64ba', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0825c5-fdad-4485-93f4-3fe1bedde353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:31 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Volume volume-09bccdf0-b862-431e-9f4d-6399056f64ba (09bccdf0-b862-431e-9f4d-6399056f64ba): created successfully Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0825c5-fdad-4485-93f4-3fe1bedde353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (abe7dc2c-2fd3-43d7-ac6f-f1f563e51cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7dbdb04f-3acb-44e4-84d9-ead835c76621 tempest-VolumesGetTest-1339138920 None] Created volume successfully. Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Creating offline snapshot dfe92c2b-a7f7-4b60-9cf5-a4226c80849b of volume d3d3a588-4a25-4edb-af69-edfb0f186839 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f26502-d977-4ebd-8a40-fe6d43f8eb68]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:31 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 Sep 03 11:04:31 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Flow 'volume_create_manager' (fa7aa807-c27c-4848-8846-6780f4514886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a506a7-6153-4678-879a-baf807e91f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a506a7-6153-4678-879a-baf807e91f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1502944889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8882cd40-3164-4877-87ce-eb8e2e884f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d5041a3fdb4ea08dcfbc813cfbcfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:32Z,use_quota=True,user_id='26eaa7e6ce624932b8283cc552286de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f47bfe7-2f5d-4394-ba65-381f3d028001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f47bfe7-2f5d-4394-ba65-381f3d028001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f9cb33-c352-4ae5-8c7c-e3068536b9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f9cb33-c352-4ae5-8c7c-e3068536b9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8882cd40-3164-4877-87ce-eb8e2e884f6a', 'volume_name': 'volume-8882cd40-3164-4877-87ce-eb8e2e884f6a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01795e8-1a84-4e49-a7c5-8e55d9982781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01795e8-1a84-4e49-a7c5-8e55d9982781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819a9476-c87e-4cc8-8642-e63ca7e908a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:31 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Volume 8882cd40-3164-4877-87ce-eb8e2e884f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8882cd40-3164-4877-87ce-eb8e2e884f6a', 'volume_size': 1} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:31 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839" returned: 0 in 0.435s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b 2G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:32 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b 2G Sep 03 11:04:32 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:32 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b 2G" returned: 0 in 0.451s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3d3a588-4a25-4edb-af69-edfb0f186839 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:32 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3d3a588-4a25-4edb-af69-edfb0f186839 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b Sep 03 11:04:32 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-09bccdf0-b862-431e-9f4d-6399056f64ba-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Lock "cinder-09bccdf0-b862-431e-9f4d-6399056f64ba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-quobyte-09bccdf0-b862-431e-9f4d-6399056f64ba" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-09bccdf0-b862-431e-9f4d-6399056f64ba" acquired by "delete_volume" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a581c-2b16-4f2a-9abb-969eae067d01]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:32 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3d3a588-4a25-4edb-af69-edfb0f186839 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b" returned: 0 in 0.410s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:32 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b is being set with open permissions: ugo+rw Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:32 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b Sep 03 11:04:32 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:32 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba Sep 03 11:04:32 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:32 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Flow 'volume_create_manager' (e2e073db-5650-4d3a-ae6b-804b574ee13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8851b41a-dcb9-481f-9a15-9445691990dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8851b41a-dcb9-481f-9a15-9445691990dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-329974201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158fb86c-5edf-48e4-9b66-0b053bae9d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083fdebf4b2942c89143d26d762cb9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:33Z,use_quota=True,user_id='2243418d99834ffea0a56093888b4184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af13419-5fc1-47cd-b15f-83e771651d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af13419-5fc1-47cd-b15f-83e771651d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bfcbf6-3a92-4286-91f3-02c3afa203f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bfcbf6-3a92-4286-91f3-02c3afa203f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158fb86c-5edf-48e4-9b66-0b053bae9d66', 'volume_name': 'volume-158fb86c-5edf-48e4-9b66-0b053bae9d66', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7f1e22-d998-490b-b743-a0dc09a5ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7f1e22-d998-490b-b743-a0dc09a5ceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3eb8d1c-a229-4220-8786-0f4c5fdef698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:33 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Volume 158fb86c-5edf-48e4-9b66-0b053bae9d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158fb86c-5edf-48e4-9b66-0b053bae9d66', 'volume_size': 1} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:33 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b" returned: 0 in 0.290s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:33 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba" returned: 0 in 0.454s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:33 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.info Sep 03 11:04:33 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:33 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba Sep 03 11:04:33 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:33 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.info" returned: 0 in 0.262s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:33 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.info is being set with open permissions: ugo+rw Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:33 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-09bccdf0-b862-431e-9f4d-6399056f64ba" returned: 0 in 0.257s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-09bccdf0-b862-431e-9f4d-6399056f64ba" released by "delete_volume" :: held 0.783s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:33 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.info Sep 03 11:04:33 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Created reservations ['0930a0cd-1d71-4c3e-b7c9-f428883e2794', '83630bde-c5f2-48f2-b419-a0ecdc625533', '44f4227e-18ac-4da9-a7e8-75bb020e1f8f', '2f012a94-9970-409c-83ee-ddb5e3ce8dbe'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:33 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:33 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:33 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.info" returned: 0 in 0.260s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1502944889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8882cd40-3164-4877-87ce-eb8e2e884f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d5041a3fdb4ea08dcfbc813cfbcfdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:32Z,use_quota=True,user_id='26eaa7e6ce624932b8283cc552286de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Creating volume 8882cd40-3164-4877-87ce-eb8e2e884f6a {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:33 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:33 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a 1073741824 Sep 03 11:04:33 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:33 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ced0c6bc-5966-4cd9-aeac-bcf54a1e1ed0 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Create snapshot completed successfully Sep 03 11:04:33 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.303s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-c29e41ae-8423-4971-b508-4faa60c56a2e-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:33 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Deleted volume successfully. Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Lock "cinder-c29e41ae-8423-4971-b508-4faa60c56a2e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fa38639c-1a6d-4d22-9cb8-f475674845d7 tempest-VolumesGetTest-1339138920 None] Lock "cinder-09bccdf0-b862-431e-9f4d-6399056f64ba-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-quobyte-c29e41ae-8423-4971-b508-4faa60c56a2e" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-c29e41ae-8423-4971-b508-4faa60c56a2e" acquired by "delete_volume" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c10c374-1c21-42ce-b610-3413f9df2327]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:34 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e Sep 03 11:04:34 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:34 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a 1073741824" returned: 0 in 0.523s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:34 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a Sep 03 11:04:34 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:34 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e" returned: 0 in 0.391s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:34 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e Sep 03 11:04:34 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:34 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a" returned: 0 in 0.266s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.495s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-329974201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158fb86c-5edf-48e4-9b66-0b053bae9d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083fdebf4b2942c89143d26d762cb9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:33Z,use_quota=True,user_id='2243418d99834ffea0a56093888b4184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Creating volume 158fb86c-5edf-48e4-9b66-0b053bae9d66 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:34 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:34 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 1073741824 Sep 03 11:04:34 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819a9476-c87e-4cc8-8642-e63ca7e908a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8882cd40-3164-4877-87ce-eb8e2e884f6a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4747d853-b9cc-4a10-9b60-1d186286f86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:34 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Volume volume-8882cd40-3164-4877-87ce-eb8e2e884f6a (8882cd40-3164-4877-87ce-eb8e2e884f6a): created successfully Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4747d853-b9cc-4a10-9b60-1d186286f86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Flow 'volume_create_manager' (fa7aa807-c27c-4848-8846-6780f4514886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:34 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-782bd079-1001-46b3-90bf-3b963e984ffd tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Created volume successfully. Sep 03 11:04:34 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c29e41ae-8423-4971-b508-4faa60c56a2e" returned: 0 in 0.270s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-c29e41ae-8423-4971-b508-4faa60c56a2e" released by "delete_volume" :: held 0.713s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Created reservations ['43013796-034e-4779-a87b-fc85240773f7', '6f83acd7-585f-4d9b-919d-c674ba332a5e', '2d27e060-7a22-4eb8-ad50-4a509a9eb931', 'f0b2c6db-d248-4297-94ba-ffae873227d8'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Acquiring lock "cinder-dfe92c2b-a7f7-4b60-9cf5-a4226c80849b-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:34 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:34 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-dfe92c2b-a7f7-4b60-9cf5-a4226c80849b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Acquiring lock "cinder-quobyte-d3d3a588-4a25-4edb-af69-edfb0f186839" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-quobyte-d3d3a588-4a25-4edb-af69-edfb0f186839" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Acquiring lock "cinder-quobyte-dfe92c2b-a7f7-4b60-9cf5-a4226c80849b" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-quobyte-dfe92c2b-a7f7-4b60-9cf5-a4226c80849b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Deleting offline snapshot dfe92c2b-a7f7-4b60-9cf5-a4226c80849b of volume d3d3a588-4a25-4edb-af69-edfb0f186839 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:04:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] snapshot_file for this snap is: volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[557c0728-c430-401b-b1c6-6b782bb1ec30]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:35 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b Sep 03 11:04:35 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:35 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 1073741824" returned: 0 in 0.613s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:35 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.400s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:35 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Deleted volume successfully. Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-cbcf093a-61c5-4adc-9aff-838bd692e073-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:35 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 Sep 03 11:04:35 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Lock "cinder-cbcf093a-61c5-4adc-9aff-838bd692e073-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-93380b47-75c5-45a2-b8e9-8bce9a954903 tempest-VolumesGetTest-1339138920 None] Lock "cinder-c29e41ae-8423-4971-b508-4faa60c56a2e-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-quobyte-cbcf093a-61c5-4adc-9aff-838bd692e073" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-cbcf093a-61c5-4adc-9aff-838bd692e073" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baa70ed-4624-4f8a-ab34-6eb2d32f7c2b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:35 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b" returned: 0 in 0.486s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3d3a588-4a25-4edb-af69-edfb0f186839(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[710976b0-f122-428a-a023-6c96deb15b12]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:35 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66" returned: 0 in 0.328s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:35 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 Sep 03 11:04:35 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3eb8d1c-a229-4220-8786-0f4c5fdef698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158fb86c-5edf-48e4-9b66-0b053bae9d66', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85118aaa-ffd5-4978-ad2a-a355eb7780a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:35 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Volume volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 (158fb86c-5edf-48e4-9b66-0b053bae9d66): created successfully Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85118aaa-ffd5-4978-ad2a-a355eb7780a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Flow 'volume_create_manager' (e2e073db-5650-4d3a-ae6b-804b574ee13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:35 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 Sep 03 11:04:35 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:35 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7d4b05a6-b558-4d4f-a425-a2509e2604c2 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Created volume successfully. Sep 03 11:04:35 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073" returned: 0 in 0.474s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:35 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073 Sep 03 11:04:35 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:36 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839" returned: 0 in 0.462s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:36 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b Sep 03 11:04:36 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:36 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cbcf093a-61c5-4adc-9aff-838bd692e073" returned: 0 in 0.295s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-d5bdb76a-fedd-47d1-b4a4-cbd905591acd req-182358f6-92fd-444c-85d3-b501c71f6f67 tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-d5bdb76a-fedd-47d1-b4a4-cbd905591acd req-182358f6-92fd-444c-85d3-b501c71f6f67 tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-cbcf093a-61c5-4adc-9aff-838bd692e073" released by "delete_volume" :: held 0.858s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-d5bdb76a-fedd-47d1-b4a4-cbd905591acd req-182358f6-92fd-444c-85d3-b501c71f6f67 tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Acquiring lock "cinder-158fb86c-5edf-48e4-9b66-0b053bae9d66-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "cinder-158fb86c-5edf-48e4-9b66-0b053bae9d66-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-d5bdb76a-fedd-47d1-b4a4-cbd905591acd req-182358f6-92fd-444c-85d3-b501c71f6f67 tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-8882cd40-3164-4877-87ce-eb8e2e884f6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38d027bf-af25-4694-91d7-644f72f3dad0', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Acquiring lock "cinder-quobyte-158fb86c-5edf-48e4-9b66-0b053bae9d66" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Created reservations ['9d36be00-2aaf-4dfa-a46f-0943def05aae', '2e433053-2f3f-491a-80ed-b97dc0a2cc02', 'ba2b4445-4672-4b5f-bb39-37d551540307', '69397ce7-41bb-4f65-a9a3-a0966a577a66'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "cinder-quobyte-158fb86c-5edf-48e4-9b66-0b053bae9d66" acquired by "delete_volume" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fa5de3-3740-42e4-b5ca-aadb3515efc8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:36 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b" returned: 0 in 0.474s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-d5bdb76a-fedd-47d1-b4a4-cbd905591acd req-182358f6-92fd-444c-85d3-b501c71f6f67 tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] attachment_update completed successfully. Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:36 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b Sep 03 11:04:36 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:36 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 Sep 03 11:04:36 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:36 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:36 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:36 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839.dfe92c2b-a7f7-4b60-9cf5-a4226c80849b" returned: 0 in 0.328s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-quobyte-dfe92c2b-a7f7-4b60-9cf5-a4226c80849b" released by "_delete_snapshot" :: held 1.943s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-quobyte-d3d3a588-4a25-4edb-af69-edfb0f186839" released by "delete_snapshot" :: held 1.974s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:36 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66" returned: 0 in 0.466s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:36 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.369s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Deleted volume successfully. Sep 03 11:04:36 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66 Sep 03 11:04:36 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b69975fb-7ea2-4249-8047-8fd3205abfbc tempest-VolumesGetTest-1339138920 None] Lock "cinder-cbcf093a-61c5-4adc-9aff-838bd692e073-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:36 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Created reservations ['a60cf03d-5208-4d82-bc36-949c8024639e', '25c24373-e99b-4096-afd6-af84658a04de', '8daeda59-447b-4e32-8908-e17f5d0a9a58', '705f54e2-713e-43ce-9b47-b72223d76e71'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Delete snapshot completed successfully. Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad6c6d5e-f846-4892-a987-545b7689b0c1 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-dfe92c2b-a7f7-4b60-9cf5-a4226c80849b-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:37 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-158fb86c-5edf-48e4-9b66-0b053bae9d66" returned: 0 in 0.311s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "cinder-quobyte-158fb86c-5edf-48e4-9b66-0b053bae9d66" released by "delete_volume" :: held 0.825s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Created reservations ['799d195e-902c-4a25-ba68-aeb7487f564d', '0b14aacc-a1df-4fc6-b5af-92031da4b608', 'f0587ec9-e18b-43b1-9fff-3926cb79b8d4', 'f4d121e6-6ecc-48e8-8ccd-25dcb514c1a3'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:37 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:37 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:37 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.298s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Deleted volume successfully. Sep 03 11:04:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d486a0c6-454a-45e0-9f46-44ac153758aa tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "cinder-158fb86c-5edf-48e4-9b66-0b053bae9d66-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Flow 'volume_create_manager' (99113079-f2ac-4ecb-bf9c-45f899d95cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdd5e95-11bb-479f-a09f-29adf7f25da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdd5e95-11bb-479f-a09f-29adf7f25da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-480423080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083fdebf4b2942c89143d26d762cb9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:38Z,use_quota=True,user_id='2243418d99834ffea0a56093888b4184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f831109b-b2de-4bc2-a2f4-012fd9d51e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f831109b-b2de-4bc2-a2f4-012fd9d51e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b990e4-bbf9-4b76-b554-fa9979c3f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b990e4-bbf9-4b76-b554-fa9979c3f49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363', 'volume_name': 'volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4d8b44-7ac1-49e8-b808-577894e74584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4d8b44-7ac1-49e8-b808-577894e74584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b24149-af89-4fe9-b302-0a8e6ad360c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:38 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Volume 17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363', 'volume_size': 1} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-480423080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='083fdebf4b2942c89143d26d762cb9d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:38Z,use_quota=True,user_id='2243418d99834ffea0a56093888b4184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Creating volume 17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:38 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:38 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 1073741824 Sep 03 11:04:38 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Acquiring lock "cinder-d3d3a588-4a25-4edb-af69-edfb0f186839-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-d3d3a588-4a25-4edb-af69-edfb0f186839-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Acquiring lock "cinder-quobyte-d3d3a588-4a25-4edb-af69-edfb0f186839" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-quobyte-d3d3a588-4a25-4edb-af69-edfb0f186839" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdeea1c-79de-480e-bedc-f6c445f94e7d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (5344fce2-4c1b-4821-9823-b45b1a03b942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4400bff-b42b-49ad-b6f4-1bcc87874943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4400bff-b42b-49ad-b6f4-1bcc87874943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1672143213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b260b90-26f5-4967-9204-00af814081d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:38Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639b1a4d-995a-427c-b8a8-6ae611121ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639b1a4d-995a-427c-b8a8-6ae611121ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f194c25-fbf9-4948-8804-877e22ee9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:04:38 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 Sep 03 11:04:38 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:38 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 1073741824" returned: 0 in 0.582s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:38 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 Sep 03 11:04:38 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:38 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839" returned: 0 in 0.512s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:38 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839 Sep 03 11:04:38 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:38 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f194c25-fbf9-4948-8804-877e22ee9074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b260b90-26f5-4967-9204-00af814081d2', 'volume_name': 'volume-3b260b90-26f5-4967-9204-00af814081d2', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138ed175-210f-4c46-97c0-9f5e2f35fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138ed175-210f-4c46-97c0-9f5e2f35fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b76205c-1bdf-49af-9ad3-e4f9c6760284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:39 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Volume 3b260b90-26f5-4967-9204-00af814081d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b260b90-26f5-4967-9204-00af814081d2', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Trying to clone 3b260b90-26f5-4967-9204-00af814081d2 from image f9d13994-8b06-4b71-9618-b02e2701e179 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:04:39 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363" returned: 0 in 0.343s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b24149-af89-4fe9-b302-0a8e6ad360c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855d7ba6-7dc0-486b-a617-d67077a28976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:39 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Volume volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 (17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363): created successfully Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855d7ba6-7dc0-486b-a617-d67077a28976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Flow 'volume_create_manager' (99113079-f2ac-4ecb-bf9c-45f899d95cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3f478038-9471-4b61-aead-56bb6f95fbb3 tempest-VolumeQuotasAdminTestJSON-1821422912 None] Created volume successfully. Sep 03 11:04:39 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3d3a588-4a25-4edb-af69-edfb0f186839" returned: 0 in 0.392s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-quobyte-d3d3a588-4a25-4edb-af69-edfb0f186839" released by "delete_volume" :: held 0.992s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:04:39 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Created reservations ['6518af88-f025-4955-a583-7f79a0b67118', 'ea3b03c0-62f2-42fc-821e-8a392130b0d3', 'ae362787-5318-4979-a69f-6c670309179e', '55af13c0-a700-46fb-9d62-351da9fb4bf7'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[987a1ea3-6457-4784-910d-a1baf1274877]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:39 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:39 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:39 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD Sep 03 11:04:39 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-66ae5e75-15d5-4cc1-b63c-ddbbcfc42ef2 req-c9eb160c-3c09-4039-9697-922d4b5f97b0 tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Terminate volume connection completed successfully. Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-66ae5e75-15d5-4cc1-b63c-ddbbcfc42ef2 req-c9eb160c-3c09-4039-9697-922d4b5f97b0 tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Deleting attachment 38d027bf-af25-4694-91d7-644f72f3dad0. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:04:39 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.344s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:39 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Deleted volume successfully. Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-88e3a116-8449-4929-a801-bac7e86f9219 tempest-VolumesSnapshotNegativeTestJSON-1456176297 None] Lock "cinder-d3d3a588-4a25-4edb-af69-edfb0f186839-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:40 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 is fetched for user b731388523914470b89260fcc3f36798. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac7f058-8e80-4e00-b33b-b72bbf595bdb]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:40 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD Sep 03 11:04:40 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:40 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1672143213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b260b90-26f5-4967-9204-00af814081d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:38Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Creating volume 3b260b90-26f5-4967-9204-00af814081d2 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:40 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:40 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 1073741824 Sep 03 11:04:40 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Acquiring lock "cinder-8882cd40-3164-4877-87ce-eb8e2e884f6a-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "cinder-8882cd40-3164-4877-87ce-eb8e2e884f6a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Acquiring lock "cinder-quobyte-8882cd40-3164-4877-87ce-eb8e2e884f6a" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-21d3b4d5-642b-4bf4-8549-809a9fe4d7ee tempest-VolumeQuotasAdminTestJSON-1356966534 None] Transfer volume completed successfully. Sep 03 11:04:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "cinder-quobyte-8882cd40-3164-4877-87ce-eb8e2e884f6a" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7851749-ab8a-4773-b616-aacdc91cceff]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:41 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a Sep 03 11:04:41 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:41 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 1073741824" returned: 0 in 0.653s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:41 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 Sep 03 11:04:41 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:41 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a" returned: 0 in 0.518s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:41 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Acquiring lock "cinder-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:41 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Lock "cinder-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:41 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2" returned: 0 in 0.418s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Acquiring lock "cinder-quobyte-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Attempting download of f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume 3b260b90-26f5-4967-9204-00af814081d2. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Lock "cinder-quobyte-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363" acquired by "delete_volume" :: waited 0.042s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[918e04de-ae63-4808-b474-d243dd037194]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[530f917d-05bc-4c04-80be-da76edcbc335]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_i7kd6gss {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:41 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8882cd40-3164-4877-87ce-eb8e2e884f6a" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:41 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 Sep 03 11:04:41 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "cinder-quobyte-8882cd40-3164-4877-87ce-eb8e2e884f6a" released by "delete_volume" :: held 0.993s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:41 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_i7kd6gss Sep 03 11:04:41 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Created reservations ['4d65bf30-5d55-4e9f-8d06-fb031c458496', '25463ccd-6c03-4448-a14e-28d0df1c5033', '78bc4206-0503-46e6-a2b1-8c82b38f319f', '46774925-6780-4747-b96e-66b2e61d61bb'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:42 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:42 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:42 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_i7kd6gss" returned: 0 in 0.440s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_i7kd6gss {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:42 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363" returned: 0 in 0.498s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:42 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363 Sep 03 11:04:42 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:42 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.291s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:42 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Deleted volume successfully. Sep 03 11:04:42 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_i7kd6gss Sep 03 11:04:42 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9b7bd9cc-6ce6-47bb-af2a-3ae6299c03bb tempest-TestServerVolumeAttachScenarioOldVersion-568437774 None] Lock "cinder-8882cd40-3164-4877-87ce-eb8e2e884f6a-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:42 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363" returned: 0 in 0.286s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Lock "cinder-quobyte-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363" released by "delete_volume" :: held 0.847s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Created reservations ['2c5cfe86-cdd8-4579-831b-35b5b91b293f', 'e68a09f3-6825-4aa1-9021-91d6219763af', '9980a786-bec5-446b-a5a0-c1bab125a1c0', '95378ba5-68ef-4d1c-9374-03f36ef726df'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:42 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_i7kd6gss" returned: 1 in 0.409s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_i7kd6gss' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b24119-30eb-423f-a103-cbb9fc95e5a9]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:42 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:42 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:42 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD Sep 03 11:04:42 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:43 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.329s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:43 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:43 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:43 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] f9d13994-8b06-4b71-9618-b02e2701e179 was qcow2, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:04:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Deleted volume successfully. Sep 03 11:04:43 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 Sep 03 11:04:43 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-08987dea-b96c-4a9e-b1c7-7dd7730ed946 tempest-VolumeQuotasAdminTestJSON-1474312576 None] Lock "cinder-17fd4c8f-7ba8-4cb9-84ac-0769a3bf2363-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:45 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2" returned: 0 in 2.847s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:45 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_8ws4dwaxdevstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:04:45 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Converted 112.00 MB image at 39.33 MB/s Sep 03 11:04:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:46 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 1G Sep 03 11:04:46 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:46 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 1G" returned: 0 in 0.328s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Downloaded image f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume 3b260b90-26f5-4967-9204-00af814081d2 successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 for user b731388523914470b89260fcc3f36798 is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Marking volume 3b260b90-26f5-4967-9204-00af814081d2 as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Copying metadata from image f9d13994-8b06-4b71-9618-b02e2701e179 to 3b260b90-26f5-4967-9204-00af814081d2. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Creating volume glance metadata for volume 3b260b90-26f5-4967-9204-00af814081d2 backed by image f9d13994-8b06-4b71-9618-b02e2701e179 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b76205c-1bdf-49af-9ad3-e4f9c6760284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b260b90-26f5-4967-9204-00af814081d2', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac02489f-c134-4cf6-b3f3-03d12f92cf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:46 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Volume volume-3b260b90-26f5-4967-9204-00af814081d2 (3b260b90-26f5-4967-9204-00af814081d2): created successfully Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac02489f-c134-4cf6-b3f3-03d12f92cf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (5344fce2-4c1b-4821-9823-b45b1a03b942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:46 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-dd0af698-492e-4115-b39b-c0575603811a tempest-VolumesGetTest-1339138920 None] Created volume successfully. Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (501d025c-372b-47e0-8cbf-e4c7bae63a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b252f1-cdc9-4f2c-bd85-f07a5acc0627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b252f1-cdc9-4f2c-bd85-f07a5acc0627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-881993655',display_name='tempest-VolumesGetTest-Volume-2109492799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b2c04b-d2ec-45b9-89ee-e733275247c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:48Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beff9330-385b-4728-9e92-012b1f388d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beff9330-385b-4728-9e92-012b1f388d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16399bc2-d052-4cd8-a9be-cbaa387a311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16399bc2-d052-4cd8-a9be-cbaa387a311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b2c04b-d2ec-45b9-89ee-e733275247c4', 'volume_name': 'volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153d08ca-79ec-42b2-a8cf-a72ac6061316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153d08ca-79ec-42b2-a8cf-a72ac6061316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab5a6f7-344c-4d84-a3df-0ce571759c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:48 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Volume d3b2c04b-d2ec-45b9-89ee-e733275247c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4', 'volume_size': 1} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-881993655',display_name='tempest-VolumesGetTest-Volume-2109492799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b2c04b-d2ec-45b9-89ee-e733275247c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1e0eaa8b694ec5b4f9523bd26ab28e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:48Z,use_quota=True,user_id='b731388523914470b89260fcc3f36798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Creating volume d3b2c04b-d2ec-45b9-89ee-e733275247c4 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:48 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:48 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 1073741824 Sep 03 11:04:48 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:48 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 1073741824" returned: 0 in 0.542s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:49 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 Sep 03 11:04:49 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:49 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4" returned: 0 in 0.380s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab5a6f7-344c-4d84-a3df-0ce571759c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541ae8d3-86f2-4b88-984b-9f7e176b4439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:49 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Volume volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 (d3b2c04b-d2ec-45b9-89ee-e733275247c4): created successfully Sep 03 11:04:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541ae8d3-86f2-4b88-984b-9f7e176b4439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Flow 'volume_create_manager' (501d025c-372b-47e0-8cbf-e4c7bae63a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-109fe935-82bd-4c95-93ff-4d0ff2e265ce tempest-VolumesGetTest-1339138920 None] Created volume successfully. Sep 03 11:04:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-d3b2c04b-d2ec-45b9-89ee-e733275247c4-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Lock "cinder-d3b2c04b-d2ec-45b9-89ee-e733275247c4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-quobyte-d3b2c04b-d2ec-45b9-89ee-e733275247c4" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-d3b2c04b-d2ec-45b9-89ee-e733275247c4" acquired by "delete_volume" :: waited 0.033s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:50 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df86cad-ef99-41ce-83ba-08a2b748aa3f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:51 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 Sep 03 11:04:51 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:51 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4" returned: 0 in 0.506s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:51 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4 Sep 03 11:04:51 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:51 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d3b2c04b-d2ec-45b9-89ee-e733275247c4" returned: 0 in 0.325s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-d3b2c04b-d2ec-45b9-89ee-e733275247c4" released by "delete_volume" :: held 0.902s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Created reservations ['16924b63-8f5b-48d2-a771-3bb1d8808582', 'ac2674e5-8c49-48d2-8f5a-9841ffba0d42', '82d8aa9a-4286-47db-b0c7-fb071bca15fc', '7af886e1-fd88-4044-8901-bad93b40c322'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:51 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:51 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:52 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.382s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:52 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:52 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Deleted volume successfully. Sep 03 11:04:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2620e67d-8fc0-427a-ba6f-e1d59f8a28c4 tempest-VolumesGetTest-1339138920 None] Lock "cinder-d3b2c04b-d2ec-45b9-89ee-e733275247c4-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-3b260b90-26f5-4967-9204-00af814081d2-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Lock "cinder-3b260b90-26f5-4967-9204-00af814081d2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Acquiring lock "cinder-quobyte-3b260b90-26f5-4967-9204-00af814081d2" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-3b260b90-26f5-4967-9204-00af814081d2" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:53 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[594cd1c2-3f80-4c1c-9fe8-eae5c264f684]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:53 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 Sep 03 11:04:53 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:53 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2" returned: 0 in 0.565s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:53 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2 Sep 03 11:04:53 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:54 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3b260b90-26f5-4967-9204-00af814081d2" returned: 0 in 0.344s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Lock "cinder-quobyte-3b260b90-26f5-4967-9204-00af814081d2" released by "delete_volume" :: held 0.987s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Created reservations ['51385519-ad22-44ac-9748-175a05064546', 'b5d9802c-fdd4-4019-8d02-214e3fc1fc19', 'c73289cd-c2aa-47c5-b142-6dc90f7ef09b', '71a98966-b9b2-4a06-9f57-b1f1e78d2160'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:54 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:54 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:54 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.367s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:54 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Deleted volume successfully. Sep 03 11:04:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-50c8390f-8c85-4443-9f7b-c83228776f09 tempest-VolumesGetTest-1339138920 None] Lock "cinder-3b260b90-26f5-4967-9204-00af814081d2-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Flow 'volume_create_manager' (590a94d0-21eb-4bf1-877b-a8fdac6032ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9a7275-0b32-4494-975d-5be63992f0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9a7275-0b32-4494-975d-5be63992f0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1379578166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfe24d3-a204-4118-8050-42ce5698f7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a47f49b06904381913b5fcc814abd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:55Z,use_quota=True,user_id='11d54b5941a34d24b421bc205b2a294e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39e3cb0e-2780-404d-abf0-a5e6afac4482),volume_type_id=39e3cb0e-2780-404d-abf0-a5e6afac4482)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff72c1dc-df0e-4569-88bc-6737f42a09fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff72c1dc-df0e-4569-88bc-6737f42a09fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c71f134-9e10-409c-b269-e735d815cbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c71f134-9e10-409c-b269-e735d815cbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfe24d3-a204-4118-8050-42ce5698f7da', 'volume_name': 'volume-7dfe24d3-a204-4118-8050-42ce5698f7da', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74690fa3-ddaa-4ef8-955a-8dc9b91758ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74690fa3-ddaa-4ef8-955a-8dc9b91758ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557773c0-7602-4347-8472-3d3d724190aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Volume 7dfe24d3-a204-4118-8050-42ce5698f7da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfe24d3-a204-4118-8050-42ce5698f7da', 'volume_size': 1} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1379578166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfe24d3-a204-4118-8050-42ce5698f7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a47f49b06904381913b5fcc814abd19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:04:55Z,use_quota=True,user_id='11d54b5941a34d24b421bc205b2a294e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39e3cb0e-2780-404d-abf0-a5e6afac4482),volume_type_id=39e3cb0e-2780-404d-abf0-a5e6afac4482)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Creating volume 7dfe24d3-a204-4118-8050-42ce5698f7da {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:04:55 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:55 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da 1073741824 Sep 03 11:04:55 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:55 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da 1073741824" returned: 0 in 0.726s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:55 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da Sep 03 11:04:55 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:56 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da" returned: 0 in 0.331s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:04:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557773c0-7602-4347-8472-3d3d724190aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfe24d3-a204-4118-8050-42ce5698f7da', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf68f4c5-b659-43c4-a7c7-66a84b31925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:04:56 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Volume volume-7dfe24d3-a204-4118-8050-42ce5698f7da (7dfe24d3-a204-4118-8050-42ce5698f7da): created successfully Sep 03 11:04:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf68f4c5-b659-43c4-a7c7-66a84b31925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:04:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Flow 'volume_create_manager' (590a94d0-21eb-4bf1-877b-a8fdac6032ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:04:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0c986361-e9cc-48e1-ad8f-2d23d9c25c58 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Created volume successfully. Sep 03 11:04:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a43015d-0dee-4c07-9d20-92d57439e787 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:04:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a43015d-0dee-4c07-9d20-92d57439e787 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:04:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8a43015d-0dee-4c07-9d20-92d57439e787 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:04:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8a43015d-0dee-4c07-9d20-92d57439e787 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:04:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a43015d-0dee-4c07-9d20-92d57439e787 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:04:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a43015d-0dee-4c07-9d20-92d57439e787 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:57 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:04:57 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:57 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a43015d-0dee-4c07-9d20-92d57439e787 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.339s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:57 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-8a43015d-0dee-4c07-9d20-92d57439e787 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:04:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8a43015d-0dee-4c07-9d20-92d57439e787 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Retype volume completed successfully. Sep 03 11:04:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Acquiring lock "cinder-7dfe24d3-a204-4118-8050-42ce5698f7da-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "cinder-7dfe24d3-a204-4118-8050-42ce5698f7da-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Acquiring lock "cinder-quobyte-7dfe24d3-a204-4118-8050-42ce5698f7da" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:04:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "cinder-quobyte-7dfe24d3-a204-4118-8050-42ce5698f7da" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:04:59 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5956cd1c-441a-4984-925c-18fc4b47c00e]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:04:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:59 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da Sep 03 11:04:59 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:59 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da" returned: 0 in 0.513s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:04:59 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da Sep 03 11:04:59 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:04:59 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Sep 03 11:04:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7dfe24d3-a204-4118-8050-42ce5698f7da" returned: 0 in 0.313s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:04:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "cinder-quobyte-7dfe24d3-a204-4118-8050-42ce5698f7da" released by "delete_volume" :: held 0.886s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:04:59 devstack cinder-volume[86603]: WARNING cinder.quota [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:04:59 devstack cinder-volume[86603]: WARNING cinder.quota [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Created reservations ['5c0942d1-ae4e-4dcf-b87e-ab6461f81e96', '667ab20d-80b6-4d37-9403-9111cd2e478c', 'bfe2c801-78cd-494f-b23c-748e9fa391f5', 'bad0d540-65d1-466d-98c9-e3a423a4dc53'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:00 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:00 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:00 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.394s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Deleted volume successfully. Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6d1ccd09-a101-46d3-80fd-bd841adedad1 tempest-VolumeRetypeWithoutMigrationTest-266118963 None] Lock "cinder-7dfe24d3-a204-4118-8050-42ce5698f7da-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Flow 'volume_create_manager' (eaaf66da-202d-4769-85f0-4ed101d86218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df79f05-ce19-42f4-be4e-cdf87277243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df79f05-ce19-42f4-be4e-cdf87277243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-919109623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c693d92-4f8c-4be6-a68f-21376a756abc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21adb1f35816404fb9085d141f537053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:01Z,use_quota=True,user_id='079db8b2b4c04f9583dccaea1db556af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96292f4e-6c88-4a47-81e6-5e042d6f207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96292f4e-6c88-4a47-81e6-5e042d6f207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929121ef-a3de-4787-a2a7-1b4fb1e1c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929121ef-a3de-4787-a2a7-1b4fb1e1c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c693d92-4f8c-4be6-a68f-21376a756abc', 'volume_name': 'volume-3c693d92-4f8c-4be6-a68f-21376a756abc', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef54b72-b9e5-4fe9-98fb-c4edfd5259f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef54b72-b9e5-4fe9-98fb-c4edfd5259f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0117fc1f-2091-40ed-aea3-0e69e1e3d91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:00 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Volume 3c693d92-4f8c-4be6-a68f-21376a756abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c693d92-4f8c-4be6-a68f-21376a756abc', 'volume_size': 1} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-919109623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c693d92-4f8c-4be6-a68f-21376a756abc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21adb1f35816404fb9085d141f537053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:01Z,use_quota=True,user_id='079db8b2b4c04f9583dccaea1db556af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Creating volume 3c693d92-4f8c-4be6-a68f-21376a756abc {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:00 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:00 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc 1073741824 Sep 03 11:05:00 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:01 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc 1073741824" returned: 0 in 0.543s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:01 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc Sep 03 11:05:01 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:01 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc" returned: 0 in 0.375s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0117fc1f-2091-40ed-aea3-0e69e1e3d91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c693d92-4f8c-4be6-a68f-21376a756abc', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92c9da4-78a4-407f-bdee-791fa49a5ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Volume volume-3c693d92-4f8c-4be6-a68f-21376a756abc (3c693d92-4f8c-4be6-a68f-21376a756abc): created successfully Sep 03 11:05:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92c9da4-78a4-407f-bdee-791fa49a5ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Flow 'volume_create_manager' (eaaf66da-202d-4769-85f0-4ed101d86218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f44d6c97-b61b-4156-987a-61b6fe65a6a5 tempest-VolumesListTestJSON-626620247 None] Created volume successfully. Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Flow 'volume_create_manager' (bff37a93-c227-4f9b-80d4-508afe204a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce95745-8999-4279-971a-ba328e336f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce95745-8999-4279-971a-ba328e336f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-461848140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5723ef65-9992-4bb8-8f56-19c2541ab92f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21adb1f35816404fb9085d141f537053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:03Z,use_quota=True,user_id='079db8b2b4c04f9583dccaea1db556af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de49b0f4-84de-4d40-90f0-f6e6c5264e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de49b0f4-84de-4d40-90f0-f6e6c5264e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a5e239-4cb7-41aa-95c0-9c71e3730888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a5e239-4cb7-41aa-95c0-9c71e3730888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5723ef65-9992-4bb8-8f56-19c2541ab92f', 'volume_name': 'volume-5723ef65-9992-4bb8-8f56-19c2541ab92f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7002dff8-5bf5-4639-aa6c-10407b6b5870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7002dff8-5bf5-4639-aa6c-10407b6b5870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87232cf2-fc90-41e4-ad48-124bb78944c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:03 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Volume 5723ef65-9992-4bb8-8f56-19c2541ab92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5723ef65-9992-4bb8-8f56-19c2541ab92f', 'volume_size': 1} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-461848140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5723ef65-9992-4bb8-8f56-19c2541ab92f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21adb1f35816404fb9085d141f537053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:03Z,use_quota=True,user_id='079db8b2b4c04f9583dccaea1db556af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Creating volume 5723ef65-9992-4bb8-8f56-19c2541ab92f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:03 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:03 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f 1073741824 Sep 03 11:05:03 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:04 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f 1073741824" returned: 0 in 0.596s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:04 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f Sep 03 11:05:04 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:04 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f" returned: 0 in 0.301s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87232cf2-fc90-41e4-ad48-124bb78944c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5723ef65-9992-4bb8-8f56-19c2541ab92f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d09cbb8-3951-49ca-99da-5e18b02f2952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:04 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Volume volume-5723ef65-9992-4bb8-8f56-19c2541ab92f (5723ef65-9992-4bb8-8f56-19c2541ab92f): created successfully Sep 03 11:05:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d09cbb8-3951-49ca-99da-5e18b02f2952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Flow 'volume_create_manager' (bff37a93-c227-4f9b-80d4-508afe204a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ac2ab898-8fd8-49ee-b1ab-c3922a79f6b6 tempest-VolumesListTestJSON-626620247 None] Created volume successfully. Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Flow 'volume_create_manager' (62f8a63f-9ad7-4810-86f4-f38ab801647e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9d3425-a51a-4327-b8a2-3f64835a87f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9d3425-a51a-4327-b8a2-3f64835a87f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1739102793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa08f5eb-7133-432a-af6f-15c222c24208,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21adb1f35816404fb9085d141f537053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:06Z,use_quota=True,user_id='079db8b2b4c04f9583dccaea1db556af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba50dfe-025d-4153-9f60-0f31560b49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba50dfe-025d-4153-9f60-0f31560b49b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7009e6e-3014-4da9-a79f-1fae0d4d8aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7009e6e-3014-4da9-a79f-1fae0d4d8aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa08f5eb-7133-432a-af6f-15c222c24208', 'volume_name': 'volume-fa08f5eb-7133-432a-af6f-15c222c24208', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61dec19-2f62-4734-9f31-196e897125ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61dec19-2f62-4734-9f31-196e897125ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c454b01a-68b4-45bc-93ba-863f6ef68d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:06 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Volume fa08f5eb-7133-432a-af6f-15c222c24208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa08f5eb-7133-432a-af6f-15c222c24208', 'volume_size': 1} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1739102793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa08f5eb-7133-432a-af6f-15c222c24208,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21adb1f35816404fb9085d141f537053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:06Z,use_quota=True,user_id='079db8b2b4c04f9583dccaea1db556af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Creating volume fa08f5eb-7133-432a-af6f-15c222c24208 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:06 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:06 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208 1073741824 Sep 03 11:05:06 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:07 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208 1073741824" returned: 0 in 0.556s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:07 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208 Sep 03 11:05:07 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:07 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208" returned: 0 in 0.429s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c454b01a-68b4-45bc-93ba-863f6ef68d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa08f5eb-7133-432a-af6f-15c222c24208', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4295ecb-ab7b-4fd3-a4c7-5b63cdd34cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:07 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Volume volume-fa08f5eb-7133-432a-af6f-15c222c24208 (fa08f5eb-7133-432a-af6f-15c222c24208): created successfully Sep 03 11:05:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4295ecb-ab7b-4fd3-a4c7-5b63cdd34cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Flow 'volume_create_manager' (62f8a63f-9ad7-4810-86f4-f38ab801647e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:07 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b1b2c7d3-560e-48e7-89b5-fa9adadc2617 tempest-VolumesListTestJSON-626620247 None] Created volume successfully. Sep 03 11:05:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Acquiring lock "cinder-fa08f5eb-7133-432a-af6f-15c222c24208-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Lock "cinder-fa08f5eb-7133-432a-af6f-15c222c24208-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:11 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:DELETE=15,cinder:INSERT=46,cinder:UPDATE=186,cinder:SELECT=124 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:05:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Acquiring lock "cinder-quobyte-fa08f5eb-7133-432a-af6f-15c222c24208" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Lock "cinder-quobyte-fa08f5eb-7133-432a-af6f-15c222c24208" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3691ed19-cb13-44d9-9e20-9154f412258d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Flow 'volume_create_manager' (b1c3db7d-0b0a-4ca7-8d42-fa59245be4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6c22bb-229c-48ab-8a54-7d5a57a57c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208 Sep 03 11:05:12 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6c22bb-229c-48ab-8a54-7d5a57a57c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1347187998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995cf448-e2ce-485f-b7e0-954285451003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d817d943e52d486f9af05408153c24c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:12Z,use_quota=True,user_id='fae9e23c62684462a04e9b0f26cdf664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a554fb7-88ef-491b-ad26-6ada0c019ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a554fb7-88ef-491b-ad26-6ada0c019ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5174ed42-09d6-4c62-afcb-a1f0e55840be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5174ed42-09d6-4c62-afcb-a1f0e55840be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '995cf448-e2ce-485f-b7e0-954285451003', 'volume_name': 'volume-995cf448-e2ce-485f-b7e0-954285451003', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d998855-e23c-4615-8666-aa0a589539b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d998855-e23c-4615-8666-aa0a589539b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6432aa60-b4d8-4567-a1bf-a680b26c921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Volume 995cf448-e2ce-485f-b7e0-954285451003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-995cf448-e2ce-485f-b7e0-954285451003', 'volume_size': 1} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1347187998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995cf448-e2ce-485f-b7e0-954285451003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d817d943e52d486f9af05408153c24c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:12Z,use_quota=True,user_id='fae9e23c62684462a04e9b0f26cdf664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Creating volume 995cf448-e2ce-485f-b7e0-954285451003 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:12 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:12 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003 1073741824 Sep 03 11:05:12 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (170a188d-65cb-4795-ba61-190905ac77d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be599f2f-4f78-43b5-87ab-3716780bcf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be599f2f-4f78-43b5-87ab-3716780bcf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-595161908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb7ea1c-e159-4b3c-85e9-5a6ff7923d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:12Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c631745b-88e0-49b5-9be1-09b468a4b4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c631745b-88e0-49b5-9be1-09b468a4b4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d60c435-836a-476d-8e58-cee7a0688bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d60c435-836a-476d-8e58-cee7a0688bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb7ea1c-e159-4b3c-85e9-5a6ff7923d14', 'volume_name': 'volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb0586f-d5f1-429f-9125-c94aff9c8052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb0586f-d5f1-429f-9125-c94aff9c8052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e1cfeb-3999-4d40-9cb7-c09df6402a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Volume feb7ea1c-e159-4b3c-85e9-5a6ff7923d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14', 'volume_size': 1} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (64c33330-0d1c-46da-b3fb-a7808eb3ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a42c11-ddb3-4ea6-8ba2-2ff82baf5a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a42c11-ddb3-4ea6-8ba2-2ff82baf5a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1994560165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1180960c-13e1-4da8-8a8c-a1868c198e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:12Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fca6f31-adb6-416c-a3b7-38c7e2fd3d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fca6f31-adb6-416c-a3b7-38c7e2fd3d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7790037f-0759-4b3f-b78c-d1f11ad18b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7790037f-0759-4b3f-b78c-d1f11ad18b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1180960c-13e1-4da8-8a8c-a1868c198e3b', 'volume_name': 'volume-1180960c-13e1-4da8-8a8c-a1868c198e3b', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc921502-8029-459f-a3ea-c68da04f5385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc921502-8029-459f-a3ea-c68da04f5385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057ed10b-8a3c-4e55-bd08-13eb8881f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Volume 1180960c-13e1-4da8-8a8c-a1868c198e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1180960c-13e1-4da8-8a8c-a1868c198e3b', 'volume_size': 1} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208" returned: 0 in 0.592s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:12 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208 Sep 03 11:05:12 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (309ce7e3-caa2-42c8-b970-801d2a0e750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:12 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c02d9e5-b59c-4f8a-8ba9-bc0c8ba398cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003 1073741824" returned: 0 in 0.713s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c02d9e5-b59c-4f8a-8ba9-bc0c8ba398cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1275870723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b366d3b3-21e4-4bcf-ba14-16b3c76e0178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:13Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efede41-d3ea-4103-afbe-71b32482c355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efede41-d3ea-4103-afbe-71b32482c355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cc55a1-e9ba-4a28-a87f-b8be79f0732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cc55a1-e9ba-4a28-a87f-b8be79f0732d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b366d3b3-21e4-4bcf-ba14-16b3c76e0178', 'volume_name': 'volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0219cc-8637-4314-b95a-d1702e432acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0219cc-8637-4314-b95a-d1702e432acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6b7848-dc35-45bd-97bb-13fb663910e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Volume b366d3b3-21e4-4bcf-ba14-16b3c76e0178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178', 'volume_size': 1} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-fa08f5eb-7133-432a-af6f-15c222c24208" returned: 0 in 0.441s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Lock "cinder-quobyte-fa08f5eb-7133-432a-af6f-15c222c24208" released by "delete_volume" :: held 1.106s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:13 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003 Sep 03 11:05:13 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Created reservations ['44c66c97-7545-4e52-b18c-ca26586ada17', 'abac6ae6-36e0-4914-8a14-39aabe0ffadb', 'ae9a18d5-92c1-4e93-a857-8b5eb30b53b8', '15a7cb50-4e2d-4f57-a387-2f485fc2f23b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:13 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:13 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:13 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003" returned: 0 in 0.411s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.080s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-595161908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb7ea1c-e159-4b3c-85e9-5a6ff7923d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:12Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Creating volume feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:13 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:13 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 1073741824 Sep 03 11:05:13 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (00a10613-ea23-497f-879d-0cae03822b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16149e4d-237b-4829-9b53-b788a2256916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6432aa60-b4d8-4567-a1bf-a680b26c921e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-995cf448-e2ce-485f-b7e0-954285451003', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f55516-a3ad-4a40-92ae-8128307ad531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16149e4d-237b-4829-9b53-b788a2256916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098919183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feed1a11-8c36-4b93-aaf2-cd1f83d7587f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:13Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cdb9e5-1223-47eb-8c1c-57a6e5c108c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cdb9e5-1223-47eb-8c1c-57a6e5c108c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f109f2f-1c78-4c13-b8ce-0b98526cd8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f109f2f-1c78-4c13-b8ce-0b98526cd8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feed1a11-8c36-4b93-aaf2-cd1f83d7587f', 'volume_name': 'volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91832a6d-e0d2-4824-90ac-07db3d75cae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91832a6d-e0d2-4824-90ac-07db3d75cae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5127cccd-7e25-44b9-902c-eb03740472c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Volume feed1a11-8c36-4b93-aaf2-cd1f83d7587f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f', 'volume_size': 1} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Volume volume-995cf448-e2ce-485f-b7e0-954285451003 (995cf448-e2ce-485f-b7e0-954285451003): created successfully Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f55516-a3ad-4a40-92ae-8128307ad531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:13 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Flow 'volume_create_manager' (b1c3db7d-0b0a-4ca7-8d42-fa59245be4e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.422s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Deleted volume successfully. Sep 03 11:05:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-24379b5a-80fa-4bef-b904-8ccb074c97f3 tempest-VolumesServicesTestJSON-297306365 None] Created volume successfully. Sep 03 11:05:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aee8b5b0-c887-43c8-b18e-5378175f6aad tempest-VolumesListTestJSON-626620247 None] Lock "cinder-fa08f5eb-7133-432a-af6f-15c222c24208-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Flow 'volume_create_manager' (5525862b-6fdf-4b77-b2c2-19ad5090e24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b857694-715d-4ad3-ab9c-22fdf7d2d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b857694-715d-4ad3-ab9c-22fdf7d2d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-610412812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdc942a-72a1-4c42-943f-f0dad46bdc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456d4f2a1c774371834fcbc583c54835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:14Z,use_quota=True,user_id='9c7198c42db748ee81eea4f2e52bca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7b39c9-5df5-45d2-8b4e-000da4f21cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7b39c9-5df5-45d2-8b4e-000da4f21cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84189740-5b34-463e-a27d-06254df1a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Acquiring lock "cinder-995cf448-e2ce-485f-b7e0-954285451003-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:14 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 1073741824" returned: 0 in 0.654s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Lock "cinder-995cf448-e2ce-485f-b7e0-954285451003-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (e2bf91d5-5b6e-4275-ae78-4d4cf543627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875eeb47-2285-4c39-bc13-f236b5566622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875eeb47-2285-4c39-bc13-f236b5566622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210673594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3adb5d-9313-43a1-b583-79a2217cbef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:14Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6969cf0-cdb0-42fe-a761-eed0dd7c3ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6969cf0-cdb0-42fe-a761-eed0dd7c3ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d5263b-8272-4623-8fab-48a6fc6f3152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d5263b-8272-4623-8fab-48a6fc6f3152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3adb5d-9313-43a1-b583-79a2217cbef2', 'volume_name': 'volume-7e3adb5d-9313-43a1-b583-79a2217cbef2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe62891d-eac0-4538-a2af-26237806198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe62891d-eac0-4538-a2af-26237806198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d3a497-e60d-4c26-900c-89cdb3ff7c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Volume 7e3adb5d-9313-43a1-b583-79a2217cbef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3adb5d-9313-43a1-b583-79a2217cbef2', 'volume_size': 1} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Acquiring lock "cinder-quobyte-995cf448-e2ce-485f-b7e0-954285451003" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:14 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 Sep 03 11:05:14 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Lock "cinder-quobyte-995cf448-e2ce-485f-b7e0-954285451003" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b72eb9-2739-496b-b6de-9b8bd05876b8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Acquiring lock "cinder-5723ef65-9992-4bb8-8f56-19c2541ab92f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Lock "cinder-5723ef65-9992-4bb8-8f56-19c2541ab92f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Acquiring lock "cinder-quobyte-5723ef65-9992-4bb8-8f56-19c2541ab92f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Lock "cinder-quobyte-5723ef65-9992-4bb8-8f56-19c2541ab92f" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:14 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003 Sep 03 11:05:14 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7754b8b-77c5-4417-8f35-685adfcd8863]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84189740-5b34-463e-a27d-06254df1a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cdc942a-72a1-4c42-943f-f0dad46bdc91', 'volume_name': 'volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5613293-8351-42a6-a835-e20d0f1e57a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5613293-8351-42a6-a835-e20d0f1e57a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88da691a-598f-448d-9078-c5f2ead43609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Volume 6cdc942a-72a1-4c42-943f-f0dad46bdc91: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Trying to clone 6cdc942a-72a1-4c42-943f-f0dad46bdc91 from image f9d13994-8b06-4b71-9618-b02e2701e179 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14" returned: 0 in 0.375s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1994560165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1180960c-13e1-4da8-8a8c-a1868c198e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:12Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Creating volume 1180960c-13e1-4da8-8a8c-a1868c198e3b {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:14 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:14 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f Sep 03 11:05:14 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:14 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b 1073741824 Sep 03 11:05:14 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e1cfeb-3999-4d40-9cb7-c09df6402a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200ec542-5ef6-41f9-885d-8e6bdb41f67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:14 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Volume volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 (feb7ea1c-e159-4b3c-85e9-5a6ff7923d14): created successfully Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200ec542-5ef6-41f9-885d-8e6bdb41f67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (170a188d-65cb-4795-ba61-190905ac77d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-cfa159a0-bf18-4d53-8bf5-9056443130d5 tempest-CreateVolumesFromImageTest-967417852 None] Created volume successfully. Sep 03 11:05:15 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003" returned: 0 in 0.744s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:15 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003 Sep 03 11:05:15 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:05:15 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:05:15 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f" returned: 0 in 0.671s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:15 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f Sep 03 11:05:15 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[900c2487-7055-486b-8c4e-7c0c1ee12099]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:15 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD Sep 03 11:05:15 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:15 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-995cf448-e2ce-485f-b7e0-954285451003" returned: 0 in 0.347s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Lock "cinder-quobyte-995cf448-e2ce-485f-b7e0-954285451003" released by "delete_volume" :: held 1.152s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:15 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b 1073741824" returned: 0 in 0.824s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:15 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5723ef65-9992-4bb8-8f56-19c2541ab92f" returned: 0 in 0.333s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:15 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b Sep 03 11:05:15 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Lock "cinder-quobyte-5723ef65-9992-4bb8-8f56-19c2541ab92f" released by "delete_volume" :: held 1.081s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Created reservations ['8c36c6f7-3582-478d-87bb-8d4526bdc5bc', '808112a5-1eaa-4e55-a368-7672172976dd', 'a81c8437-e9b2-4db6-a3bb-1067b567613b', '21f19eb5-b468-4e30-bfae-8525956af53e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Created reservations ['e82ac3df-3a27-4edd-b850-e7fcb9234cec', 'f6b7ec80-7a53-4169-b65d-4d6024e298a0', '5904c5b4-5bf5-4ba2-acb5-45d5ece4bde4', 'ef53b5be-2942-4026-9272-13ca33087600'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:15 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 is fetched for user 9c7198c42db748ee81eea4f2e52bca91. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:15 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:15 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c10c62e-35c6-4685-8bb4-c2fcdd014def]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:15 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:15 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:15 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b" returned: 0 in 0.321s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1275870723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b366d3b3-21e4-4bcf-ba14-16b3c76e0178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:13Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Creating volume b366d3b3-21e4-4bcf-ba14-16b3c76e0178 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:15 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057ed10b-8a3c-4e55-bd08-13eb8881f711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1180960c-13e1-4da8-8a8c-a1868c198e3b', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f4b920-e639-470a-a2bc-be4ecadf3da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:15 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 1073741824 Sep 03 11:05:15 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:15 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Volume volume-1180960c-13e1-4da8-8a8c-a1868c198e3b (1180960c-13e1-4da8-8a8c-a1868c198e3b): created successfully Sep 03 11:05:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f4b920-e639-470a-a2bc-be4ecadf3da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (64c33330-0d1c-46da-b3fb-a7808eb3ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:16 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD Sep 03 11:05:16 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-193f62b6-360b-4e8f-afbf-aa5488fb7810 tempest-CreateVolumesFromImageTest-967417852 None] Created volume successfully. Sep 03 11:05:16 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.306s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Deleted volume successfully. Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e17b1175-cd31-42af-bef2-d3240efdcfcf tempest-VolumesServicesTestJSON-297306365 None] Lock "cinder-995cf448-e2ce-485f-b7e0-954285451003-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:16 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.347s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Deleted volume successfully. Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5f5e6e8e-3dcd-4b24-83b3-5eed21303e0b tempest-VolumesListTestJSON-626620247 None] Lock "cinder-5723ef65-9992-4bb8-8f56-19c2541ab92f-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:16 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:16 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 1073741824" returned: 0 in 0.526s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:16 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 Sep 03 11:05:16 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:16 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178" returned: 0 in 0.295s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.065s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098919183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feed1a11-8c36-4b93-aaf2-cd1f83d7587f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:13Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Creating volume feed1a11-8c36-4b93-aaf2-cd1f83d7587f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:16 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6b7848-dc35-45bd-97bb-13fb663910e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:16 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f 1073741824 Sep 03 11:05:16 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f56ff7-f479-419e-a995-256e16f19b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Acquiring lock "cinder-3c693d92-4f8c-4be6-a68f-21376a756abc-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:16 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Volume volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 (b366d3b3-21e4-4bcf-ba14-16b3c76e0178): created successfully Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f56ff7-f479-419e-a995-256e16f19b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (309ce7e3-caa2-42c8-b970-801d2a0e750f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0d5cb643-67b1-4791-983f-c2ab2e98e54d tempest-CreateVolumesFromImageTest-967417852 None] Created volume successfully. Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Lock "cinder-3c693d92-4f8c-4be6-a68f-21376a756abc-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Acquiring lock "cinder-quobyte-3c693d92-4f8c-4be6-a68f-21376a756abc" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Lock "cinder-quobyte-3c693d92-4f8c-4be6-a68f-21376a756abc" acquired by "delete_volume" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adc3b0a-b71f-4f2f-a812-80b26a3b39fc]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:17 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc Sep 03 11:05:17 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:17 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f 1073741824" returned: 0 in 0.544s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:17 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f Sep 03 11:05:17 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:17 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc" returned: 0 in 0.432s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:17 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc Sep 03 11:05:17 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:17 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f" returned: 0 in 0.332s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.418s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210673594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3adb5d-9313-43a1-b583-79a2217cbef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f232c237db4a4cf39d6cba963a0f7077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:14Z,use_quota=True,user_id='e84631fed60e44af8916f218782aa33c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Creating volume 7e3adb5d-9313-43a1-b583-79a2217cbef2 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:17 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:17 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3c693d92-4f8c-4be6-a68f-21376a756abc" returned: 0 in 0.303s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:17 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 1073741824 Sep 03 11:05:17 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5127cccd-7e25-44b9-902c-eb03740472c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ddd983-28e3-4dcd-8b6e-39d6fc8b655b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Lock "cinder-quobyte-3c693d92-4f8c-4be6-a68f-21376a756abc" released by "delete_volume" :: held 0.813s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:17 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Volume volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f (feed1a11-8c36-4b93-aaf2-cd1f83d7587f): created successfully Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ddd983-28e3-4dcd-8b6e-39d6fc8b655b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (00a10613-ea23-497f-879d-0cae03822b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ec4eb492-e034-4a63-ac33-9e36d90f280c tempest-CreateVolumesFromImageTest-967417852 None] Created volume successfully. Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Created reservations ['7a9bbe43-db06-48d0-aca7-6d10b137570e', 'db7f6554-cec7-4842-b03e-5a74e7201aa4', 'fc6c383c-0d2a-4322-bbe1-076d8631eb9c', '5e478057-b1dd-4d7f-9324-9105ea99e96b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:18 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:18 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:18 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 1073741824" returned: 0 in 0.535s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:18 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.366s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Deleted volume successfully. Sep 03 11:05:18 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 Sep 03 11:05:18 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-070e9178-693a-4e89-9f3b-98fac9cfacfe tempest-VolumesListTestJSON-626620247 None] Lock "cinder-3c693d92-4f8c-4be6-a68f-21376a756abc-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:18 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2" returned: 0 in 0.301s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.335s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-610412812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdc942a-72a1-4c42-943f-f0dad46bdc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456d4f2a1c774371834fcbc583c54835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:14Z,use_quota=True,user_id='9c7198c42db748ee81eea4f2e52bca91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Creating volume 6cdc942a-72a1-4c42-943f-f0dad46bdc91 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:18 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:18 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 1073741824 Sep 03 11:05:18 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d3a497-e60d-4c26-900c-89cdb3ff7c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3adb5d-9313-43a1-b583-79a2217cbef2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09316a21-28dd-425a-8cf3-f0742ff4bc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:18 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Volume volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 (7e3adb5d-9313-43a1-b583-79a2217cbef2): created successfully Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09316a21-28dd-425a-8cf3-f0742ff4bc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Flow 'volume_create_manager' (e2bf91d5-5b6e-4275-ae78-4d4cf543627b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4708e57e-489d-4415-8d7a-87bb5ca12890 tempest-CreateVolumesFromImageTest-967417852 None] Created volume successfully. Sep 03 11:05:19 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 1073741824" returned: 0 in 0.559s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:19 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 Sep 03 11:05:19 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:19 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91" returned: 0 in 0.305s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Attempting download of f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume 6cdc942a-72a1-4c42-943f-f0dad46bdc91. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e938f13-53ba-463f-97c7-53c761aaace5]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_5ox1ua61 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:19 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_5ox1ua61 Sep 03 11:05:19 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-7e3adb5d-9313-43a1-b583-79a2217cbef2-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:19 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-7e3adb5d-9313-43a1-b583-79a2217cbef2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-quobyte-7e3adb5d-9313-43a1-b583-79a2217cbef2" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-7e3adb5d-9313-43a1-b583-79a2217cbef2" acquired by "delete_volume" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24ac8d6-4572-43cf-b786-a4a649e08274]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:20 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_5ox1ua61" returned: 0 in 0.452s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_5ox1ua61 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:20 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 Sep 03 11:05:20 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:20 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_5ox1ua61 Sep 03 11:05:20 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:20 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_5ox1ua61" returned: 1 in 0.388s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d13994-8b06-4b71-9618-b02e2701e179_5ox1ua61' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9627aa-331d-4080-a89d-502915e28801]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:20 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2" returned: 0 in 0.478s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:20 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2 Sep 03 11:05:20 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:20 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD Sep 03 11:05:20 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:20 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:20 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] f9d13994-8b06-4b71-9618-b02e2701e179 was qcow2, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e3adb5d-9313-43a1-b583-79a2217cbef2" returned: 0 in 0.363s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:20 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 Sep 03 11:05:20 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-7e3adb5d-9313-43a1-b583-79a2217cbef2" released by "delete_volume" :: held 0.899s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:20 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Created reservations ['92565242-ff58-4aaa-8734-c79050776524', 'f53e6f53-0011-47ec-a053-88ccd023fc0c', '9f4f198c-0ba0-44b7-ba24-42e86166d0b3', '327c048b-f2a9-472e-b0e8-6453031cc190'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:21 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:21 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-feed1a11-8c36-4b93-aaf2-cd1f83d7587f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-feed1a11-8c36-4b93-aaf2-cd1f83d7587f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-quobyte-feed1a11-8c36-4b93-aaf2-cd1f83d7587f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-feed1a11-8c36-4b93-aaf2-cd1f83d7587f" acquired by "delete_volume" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cbd20c-f531-4a0e-a2b2-b7a841993069]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:21 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.336s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:21 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Deleted volume successfully. Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-17c236ad-b444-4dae-9ff8-19702a489610 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-7e3adb5d-9313-43a1-b583-79a2217cbef2-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:21 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f Sep 03 11:05:21 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:21 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f" returned: 0 in 0.512s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:21 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f Sep 03 11:05:21 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:22 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feed1a11-8c36-4b93-aaf2-cd1f83d7587f" returned: 0 in 0.390s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-feed1a11-8c36-4b93-aaf2-cd1f83d7587f" released by "delete_volume" :: held 0.975s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Created reservations ['03f9ee82-6277-4e96-99e4-bb4e77b8528f', 'fd4d4522-b9b3-452c-adf0-d1fa0e911946', '9292ebe2-ce44-42c4-9841-ee0f98d75d90', 'ce88bf8b-4b08-4c95-9097-002fc3aa4d5a'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:22 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:22 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:22 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.346s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:22 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Deleted volume successfully. Sep 03 11:05:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-81f153b9-84af-406d-8743-52c3f4502e65 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-feed1a11-8c36-4b93-aaf2-cd1f83d7587f-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:23 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91" returned: 0 in 2.454s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9d13994-8b06-4b71-9618-b02e2701e179_2wqpjmi8devstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:05:23 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Converted 112.00 MB image at 45.61 MB/s Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:23 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 1G Sep 03 11:05:23 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:23 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:23 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-b366d3b3-21e4-4bcf-ba14-16b3c76e0178-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-b366d3b3-21e4-4bcf-ba14-16b3c76e0178-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-quobyte-b366d3b3-21e4-4bcf-ba14-16b3c76e0178" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-b366d3b3-21e4-4bcf-ba14-16b3c76e0178" acquired by "delete_volume" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54ef460-d67f-41a6-9036-a24f80b27f6e]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:23 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.387s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:05:23 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 1G" returned: 0 in 0.591s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Downloaded image f9d13994-8b06-4b71-9618-b02e2701e179 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}])) to volume 6cdc942a-72a1-4c42-943f-f0dad46bdc91 successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Temporary image f9d13994-8b06-4b71-9618-b02e2701e179 for user 9c7198c42db748ee81eea4f2e52bca91 is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Marking volume 6cdc942a-72a1-4c42-943f-f0dad46bdc91 as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:05:23 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Copying metadata from image f9d13994-8b06-4b71-9618-b02e2701e179 to 6cdc942a-72a1-4c42-943f-f0dad46bdc91. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:05:23 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:23 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Creating volume glance metadata for volume 6cdc942a-72a1-4c42-943f-f0dad46bdc91 backed by image f9d13994-8b06-4b71-9618-b02e2701e179 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88da691a-598f-448d-9078-c5f2ead43609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91', 'volume_size': 1, 'image_id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d13994-8b06-4b71-9618-b02e2701e179', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c508d6db6c0141e3a37d6788d563454a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9d13994-8b06-4b71-9618-b02e2701e179', 'created_at': datetime.datetime(2026, 9, 3, 8, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 8, 49, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d13994-8b06-4b71-9618-b02e2701e179/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989c6748-c83e-48a0-8156-22f88a57f492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:24 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Volume volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 (6cdc942a-72a1-4c42-943f-f0dad46bdc91): created successfully Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989c6748-c83e-48a0-8156-22f88a57f492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Flow 'volume_create_manager' (5525862b-6fdf-4b77-b2c2-19ad5090e24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:24 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-cb790d30-81ac-4572-bd2a-0bf748aabacb tempest-TestShelveInstance-1225470468 None] Created volume successfully. Sep 03 11:05:24 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178" returned: 0 in 0.483s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:24 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178 Sep 03 11:05:24 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:24 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b366d3b3-21e4-4bcf-ba14-16b3c76e0178" returned: 0 in 0.272s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-b366d3b3-21e4-4bcf-ba14-16b3c76e0178" released by "delete_volume" :: held 0.824s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Created reservations ['6f403d36-768c-4b82-8b72-4269dbed10f5', '341bd6f2-9d69-484f-a68b-e6b8d2173dde', '2e565764-dd3d-4b2a-a33d-a6cf19746aac', '4a5be262-42f6-4d15-bd29-f7aee9584fd4'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:24 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:24 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-1180960c-13e1-4da8-8a8c-a1868c198e3b-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-1180960c-13e1-4da8-8a8c-a1868c198e3b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-quobyte-1180960c-13e1-4da8-8a8c-a1868c198e3b" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-1180960c-13e1-4da8-8a8c-a1868c198e3b" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9946c2-a1f4-4542-8dc4-5052498f624d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:25 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.398s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Deleted volume successfully. Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1e4dc94c-ef1f-40f8-96ec-80bc120fc5dd tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-b366d3b3-21e4-4bcf-ba14-16b3c76e0178-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:25 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b Sep 03 11:05:25 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:25 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b" returned: 0 in 0.474s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:25 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b Sep 03 11:05:25 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:25 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1180960c-13e1-4da8-8a8c-a1868c198e3b" returned: 0 in 0.288s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-1180960c-13e1-4da8-8a8c-a1868c198e3b" released by "delete_volume" :: held 0.830s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:25 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Created reservations ['b3c88397-2939-4e93-b957-8c4962a626e7', 'f9c1496d-ca28-482a-90f9-067719bfd7f3', '83853122-be6b-4f87-a0bd-4d022000d258', '73f4d966-308a-4daa-97fc-7dbebafeaa8e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:26 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:26 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "cinder-quobyte-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa3bd66-77d7-4001-87ae-cd3715283274]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:26 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.445s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:26 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Deleted volume successfully. Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-046eab73-bcb5-4b49-9912-8607a7a4b4e9 tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-1180960c-13e1-4da8-8a8c-a1868c198e3b-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:26 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 Sep 03 11:05:26 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:26 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14" returned: 0 in 0.518s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:27 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14 Sep 03 11:05:27 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:27 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14" returned: 0 in 0.353s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-quobyte-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14" released by "delete_volume" :: held 0.948s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=185,cinder:UPDATE=216,cinder:DELETE=21,cinder:INSERT=61 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Created reservations ['ebabef47-d7c9-4d9b-a4b9-cde67f397664', 'a1889bdd-8744-4f21-bdb6-da0f9f8affbf', 'c62a8c12-0945-4255-9d00-de8c8ecd6737', '296f772b-ef9a-4c7d-93bd-236bc4605590'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:27 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:27 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:27 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.404s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:27 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:27 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Deleted volume successfully. Sep 03 11:05:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eb19f9cb-ec2a-4c5a-88e0-96f31e013edd tempest-CreateVolumesFromImageTest-967417852 None] Lock "cinder-feb7ea1c-e159-4b3c-85e9-5a6ff7923d14-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-685847d7-4380-4f8a-9f60-1f3590d6c087 req-8151339d-9b5e-4038-877e-c1d74af9415c tempest-TestShelveInstance-1225470468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-685847d7-4380-4f8a-9f60-1f3590d6c087 req-8151339d-9b5e-4038-877e-c1d74af9415c tempest-TestShelveInstance-1225470468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-685847d7-4380-4f8a-9f60-1f3590d6c087 req-8151339d-9b5e-4038-877e-c1d74af9415c tempest-TestShelveInstance-1225470468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-685847d7-4380-4f8a-9f60-1f3590d6c087 req-8151339d-9b5e-4038-877e-c1d74af9415c tempest-TestShelveInstance-1225470468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20e05686-f321-4d06-85b9-091a6ab73911', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:05:30 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-685847d7-4380-4f8a-9f60-1f3590d6c087 req-8151339d-9b5e-4038-877e-c1d74af9415c tempest-TestShelveInstance-1225470468 None] attachment_update completed successfully. Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Flow 'volume_create_manager' (48d46ecf-40ff-4f7a-ac26-2e33528d6c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26c3e23-2066-462d-95dc-a67314045ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26c3e23-2066-462d-95dc-a67314045ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-154924438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277a3388-2b7b-4fb3-a515-f0ac511d0a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aae18f2bb09402b8e4c324f4322d578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:32Z,use_quota=True,user_id='7f6cc1c8968341af8d9a6c42c36669f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(767b2c69-e8e4-489a-850c-eb0cbb9ea1d3),volume_type_id=767b2c69-e8e4-489a-850c-eb0cbb9ea1d3)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04da2113-ea64-49a6-b60f-772bc1dc15da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04da2113-ea64-49a6-b60f-772bc1dc15da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ee600e-4f3a-4fec-953d-9f0b7b2e613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ee600e-4f3a-4fec-953d-9f0b7b2e613d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277a3388-2b7b-4fb3-a515-f0ac511d0a6f', 'volume_name': 'volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5abc806-5f85-4d1e-977f-be0f5342f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5abc806-5f85-4d1e-977f-be0f5342f856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0291c9bf-d9b1-4a62-a6d6-560360f1bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:31 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Volume 277a3388-2b7b-4fb3-a515-f0ac511d0a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f', 'volume_size': 1} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-154924438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277a3388-2b7b-4fb3-a515-f0ac511d0a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aae18f2bb09402b8e4c324f4322d578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:32Z,use_quota=True,user_id='7f6cc1c8968341af8d9a6c42c36669f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(767b2c69-e8e4-489a-850c-eb0cbb9ea1d3),volume_type_id=767b2c69-e8e4-489a-850c-eb0cbb9ea1d3)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Creating volume 277a3388-2b7b-4fb3-a515-f0ac511d0a6f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:31 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:31 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f 1073741824 Sep 03 11:05:31 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:32 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f 1073741824" returned: 0 in 0.701s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:32 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f Sep 03 11:05:32 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:32 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f" returned: 0 in 0.322s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0291c9bf-d9b1-4a62-a6d6-560360f1bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24562d19-cc1f-4a7a-ade7-516a2d8d252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:32 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Volume volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f (277a3388-2b7b-4fb3-a515-f0ac511d0a6f): created successfully Sep 03 11:05:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24562d19-cc1f-4a7a-ade7-516a2d8d252e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Flow 'volume_create_manager' (48d46ecf-40ff-4f7a-ac26-2e33528d6c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-33453540-c65d-4ee3-8597-95838da98623 tempest-VolumeTypesAccessTest-211812566 None] Created volume successfully. Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (802e6082-a578-4eb8-8da1-32f59ce4bb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a4aaa7-6cef-4f68-8c3b-67e6195b77a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a4aaa7-6cef-4f68-8c3b-67e6195b77a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500511121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a14dfe-0092-4e09-977d-b3cc323033f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:33Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (066e4a37-c635-4a23-94dd-f6bb20512338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (066e4a37-c635-4a23-94dd-f6bb20512338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0280d4-4213-49a2-adc4-7c182aacb7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0280d4-4213-49a2-adc4-7c182aacb7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a14dfe-0092-4e09-977d-b3cc323033f4', 'volume_name': 'volume-86a14dfe-0092-4e09-977d-b3cc323033f4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c34a34-9428-46b6-9359-2ea9f8bcde83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c34a34-9428-46b6-9359-2ea9f8bcde83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ceaba7-4c09-409e-8c2e-5d9a0e97f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:33 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume 86a14dfe-0092-4e09-977d-b3cc323033f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a14dfe-0092-4e09-977d-b3cc323033f4', 'volume_size': 1} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500511121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a14dfe-0092-4e09-977d-b3cc323033f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:33Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Creating volume 86a14dfe-0092-4e09-977d-b3cc323033f4 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:33 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:33 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 1073741824 Sep 03 11:05:33 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Acquiring lock "cinder-277a3388-2b7b-4fb3-a515-f0ac511d0a6f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Lock "cinder-277a3388-2b7b-4fb3-a515-f0ac511d0a6f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Acquiring lock "cinder-quobyte-277a3388-2b7b-4fb3-a515-f0ac511d0a6f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Lock "cinder-quobyte-277a3388-2b7b-4fb3-a515-f0ac511d0a6f" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:33 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 1073741824" returned: 0 in 0.625s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d5667-775b-4329-8e14-f51dcf962324]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:34 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 Sep 03 11:05:34 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:34 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f Sep 03 11:05:34 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:34 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4" returned: 0 in 0.320s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ceaba7-4c09-409e-8c2e-5d9a0e97f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a14dfe-0092-4e09-977d-b3cc323033f4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677a1223-29ee-44db-81f3-e70affe07c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:34 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume volume-86a14dfe-0092-4e09-977d-b3cc323033f4 (86a14dfe-0092-4e09-977d-b3cc323033f4): created successfully Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677a1223-29ee-44db-81f3-e70affe07c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (802e6082-a578-4eb8-8da1-32f59ce4bb83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:34 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7dabc764-adc1-4cc3-9cf7-87e709b9e6bb tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created volume successfully. Sep 03 11:05:34 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f" returned: 0 in 0.583s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:34 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f Sep 03 11:05:34 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:34 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-277a3388-2b7b-4fb3-a515-f0ac511d0a6f" returned: 0 in 0.429s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Lock "cinder-quobyte-277a3388-2b7b-4fb3-a515-f0ac511d0a6f" released by "delete_volume" :: held 1.118s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:35 devstack cinder-volume[86603]: WARNING cinder.quota [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1284587096 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1284587096, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:05:35 devstack cinder-volume[86603]: WARNING cinder.quota [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1284587096 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1284587096, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:05:35 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Created reservations ['05cb8654-85f5-4c74-878f-c58b99b524d1', 'b941bc95-ad79-4f58-a1f2-96afc0fe23ad', 'd4a2e075-f06a-4407-b526-f89ebd7780ad', 'a098b3e9-d9d4-4ea8-bb1c-478be3296961'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:35 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:35 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:35 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.566s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Creating offline snapshot 855340ac-ad78-4aff-9ee2-1b3a16dab84f of volume 86a14dfe-0092-4e09-977d-b3cc323033f4 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:05:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Deleted volume successfully. Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9736ffaf-0adb-40b0-84e8-62010bc32633]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-dc44041b-f3ff-4dc0-b0d1-480e47631cd1 tempest-VolumeTypesAccessTest-211812566 None] Lock "cinder-277a3388-2b7b-4fb3-a515-f0ac511d0a6f-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:36 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 Sep 03 11:05:36 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:36 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4" returned: 0 in 0.576s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:36 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f 1G Sep 03 11:05:36 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:37 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f 1G" returned: 0 in 0.878s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86a14dfe-0092-4e09-977d-b3cc323033f4 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:37 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86a14dfe-0092-4e09-977d-b3cc323033f4 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f Sep 03 11:05:37 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:38 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86a14dfe-0092-4e09-977d-b3cc323033f4 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f" returned: 0 in 0.532s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:38 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f is being set with open permissions: ugo+rw Sep 03 11:05:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:38 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f Sep 03 11:05:38 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:38 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f" returned: 0 in 0.654s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:38 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.info Sep 03 11:05:38 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:39 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.info" returned: 0 in 0.500s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:39 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.info is being set with open permissions: ugo+rw Sep 03 11:05:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:39 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.info Sep 03 11:05:39 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:39 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.info" returned: 0 in 0.692s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.056s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c2939ec1-d6f9-4c19-a5a0-1003072f44f5 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Create snapshot completed successfully Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (b92e5b12-bba3-48a6-bb97-4faa347b7eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9f18ba-3381-467d-892b-9ef435d8f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9f18ba-3381-467d-892b-9ef435d8f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096837286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c85b72-bfd8-46a8-a44f-4f992662e4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:41Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dcb8db-f0dc-44fc-a090-4cca84525a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dcb8db-f0dc-44fc-a090-4cca84525a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d91525-374c-4347-86f0-b268b5e0856d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d91525-374c-4347-86f0-b268b5e0856d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c85b72-bfd8-46a8-a44f-4f992662e4be', 'volume_name': 'volume-11c85b72-bfd8-46a8-a44f-4f992662e4be', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e490892b-da43-46cd-ba7a-341fa02c1b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e490892b-da43-46cd-ba7a-341fa02c1b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c7ea90-9a16-46ac-99fc-a058ba791ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:41 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume 11c85b72-bfd8-46a8-a44f-4f992662e4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c85b72-bfd8-46a8-a44f-4f992662e4be', 'volume_size': 1} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096837286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c85b72-bfd8-46a8-a44f-4f992662e4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:41Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Creating volume 11c85b72-bfd8-46a8-a44f-4f992662e4be {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:41 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:41 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be 1073741824 Sep 03 11:05:41 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (20b35378-d162-4a67-9895-cdff6edaa282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458f68bf-7bb6-4641-9e52-7292e08e1974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458f68bf-7bb6-4641-9e52-7292e08e1974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1348131714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b657457-91cf-4ff9-972b-14f75c1715f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:42Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da3a24f-a1e5-4d58-9eeb-b8d18c9d1444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da3a24f-a1e5-4d58-9eeb-b8d18c9d1444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb8ed81-f54d-4a5e-830a-143f43f45865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb8ed81-f54d-4a5e-830a-143f43f45865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b657457-91cf-4ff9-972b-14f75c1715f0', 'volume_name': 'volume-6b657457-91cf-4ff9-972b-14f75c1715f0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdec560-8eae-4713-958f-490065fbf423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdec560-8eae-4713-958f-490065fbf423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb49277-e212-4d1f-9720-d27513333eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:42 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume 6b657457-91cf-4ff9-972b-14f75c1715f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b657457-91cf-4ff9-972b-14f75c1715f0', 'volume_size': 1} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:42 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be 1073741824" returned: 0 in 0.819s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:42 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be Sep 03 11:05:42 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (1c0df550-cc59-4f58-a6fa-77d62c388c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0ceee0-537b-4270-84ca-66403dbea893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:43 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be" returned: 0 in 0.562s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.887s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1348131714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b657457-91cf-4ff9-972b-14f75c1715f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:42Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Creating volume 6b657457-91cf-4ff9-972b-14f75c1715f0 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:43 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0ceee0-537b-4270-84ca-66403dbea893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-464113694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3906b606-6d91-49f1-b882-bf3190aab1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:43Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:43 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0 1073741824 Sep 03 11:05:43 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9720aa9d-4609-42a6-a9c0-78d284950399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9720aa9d-4609-42a6-a9c0-78d284950399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cad6c20-5b1e-454d-8ada-7302630f3d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cad6c20-5b1e-454d-8ada-7302630f3d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3906b606-6d91-49f1-b882-bf3190aab1ef', 'volume_name': 'volume-3906b606-6d91-49f1-b882-bf3190aab1ef', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b176d3b5-f156-4cd3-b615-118f7d3177ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b176d3b5-f156-4cd3-b615-118f7d3177ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a296566-60ce-4f3e-b1cd-ac67f6b5e9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:43 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume 3906b606-6d91-49f1-b882-bf3190aab1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3906b606-6d91-49f1-b882-bf3190aab1ef', 'volume_size': 1} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c7ea90-9a16-46ac-99fc-a058ba791ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c85b72-bfd8-46a8-a44f-4f992662e4be', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20124028-7751-4b7d-b881-12945c5ef00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:43 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume volume-11c85b72-bfd8-46a8-a44f-4f992662e4be (11c85b72-bfd8-46a8-a44f-4f992662e4be): created successfully Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20124028-7751-4b7d-b881-12945c5ef00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (b92e5b12-bba3-48a6-bb97-4faa347b7eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a9c90100-8d95-412d-b712-c0e7bbdfa6f3 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created volume successfully. Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (1a4eac95-9c30-4478-b3d6-8695df61d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a0953e-1794-401d-b292-8cede2fc9a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a0953e-1794-401d-b292-8cede2fc9a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817731536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8de185-8d88-415d-b87d-1441cebca66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:44Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd5445e-312a-4e8d-9417-f27b7b9262fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd5445e-312a-4e8d-9417-f27b7b9262fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93218483-5f5c-4887-b517-c0aab0684339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93218483-5f5c-4887-b517-c0aab0684339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc8de185-8d88-415d-b87d-1441cebca66f', 'volume_name': 'volume-dc8de185-8d88-415d-b87d-1441cebca66f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6675d7-3f35-4b36-9125-8afeed194f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6675d7-3f35-4b36-9125-8afeed194f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d0d6a2-5b58-445b-b139-6409ffec94f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume dc8de185-8d88-415d-b87d-1441cebca66f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc8de185-8d88-415d-b87d-1441cebca66f', 'volume_size': 1} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0 1073741824" returned: 0 in 1.086s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:44 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0 Sep 03 11:05:44 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (1079a17b-def7-41c6-967b-1a2258d0c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3987f0-d4e6-40a6-bee1-c5ae33bb15f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3987f0-d4e6-40a6-bee1-c5ae33bb15f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1807648041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e05bf5-86c5-4533-94b5-ef6a3a66ad1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:44Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df5e3a6-2f89-4cac-b91c-ce8dabf2baed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df5e3a6-2f89-4cac-b91c-ce8dabf2baed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207dad41-2609-49a1-b688-c3b14200dece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207dad41-2609-49a1-b688-c3b14200dece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e05bf5-86c5-4533-94b5-ef6a3a66ad1a', 'volume_name': 'volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bdd425-b11b-4cd2-b6c7-745e150c16a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bdd425-b11b-4cd2-b6c7-745e150c16a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730f103e-df0c-480e-a35c-3d5cf1e4810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume 06e05bf5-86c5-4533-94b5-ef6a3a66ad1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a', 'volume_size': 1} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:44 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0" returned: 0 in 0.504s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-464113694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3906b606-6d91-49f1-b882-bf3190aab1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:43Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Creating volume 3906b606-6d91-49f1-b882-bf3190aab1ef {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:44 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb49277-e212-4d1f-9720-d27513333eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b657457-91cf-4ff9-972b-14f75c1715f0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d2300a-8693-43dc-b9f6-799683b8a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:44 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef 1073741824 Sep 03 11:05:44 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume volume-6b657457-91cf-4ff9-972b-14f75c1715f0 (6b657457-91cf-4ff9-972b-14f75c1715f0): created successfully Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d2300a-8693-43dc-b9f6-799683b8a334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (20b35378-d162-4a67-9895-cdff6edaa282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:44 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-49f716ef-14bc-42e2-a34d-55e37e48f15e tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created volume successfully. Sep 03 11:05:45 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef 1073741824" returned: 0 in 0.716s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:45 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef Sep 03 11:05:45 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:46 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef" returned: 0 in 0.413s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.810s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817731536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8de185-8d88-415d-b87d-1441cebca66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:44Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Creating volume dc8de185-8d88-415d-b87d-1441cebca66f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:46 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a296566-60ce-4f3e-b1cd-ac67f6b5e9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3906b606-6d91-49f1-b882-bf3190aab1ef', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a2a2c8-aa09-494a-a662-3c99f5a0f77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:46 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f 1073741824 Sep 03 11:05:46 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:46 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume volume-3906b606-6d91-49f1-b882-bf3190aab1ef (3906b606-6d91-49f1-b882-bf3190aab1ef): created successfully Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a2a2c8-aa09-494a-a662-3c99f5a0f77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (1c0df550-cc59-4f58-a6fa-77d62c388c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:46 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e355d8c8-fe23-4b2f-b09d-9312988fbd49 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created volume successfully. Sep 03 11:05:46 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f 1073741824" returned: 0 in 0.680s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:46 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f Sep 03 11:05:46 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:47 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f" returned: 0 in 0.450s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.678s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1807648041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e05bf5-86c5-4533-94b5-ef6a3a66ad1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8af4b97bdb24cdcb7774f4e17d9be73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:05:44Z,use_quota=True,user_id='d97a34be1ea64782bcd588f2633edfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Creating volume 06e05bf5-86c5-4533-94b5-ef6a3a66ad1a {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:05:47 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d0d6a2-5b58-445b-b139-6409ffec94f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8de185-8d88-415d-b87d-1441cebca66f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a98faf-ffca-4d8d-861c-ac9440e0368f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:47 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a 1073741824 Sep 03 11:05:47 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:47 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume volume-dc8de185-8d88-415d-b87d-1441cebca66f (dc8de185-8d88-415d-b87d-1441cebca66f): created successfully Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a98faf-ffca-4d8d-861c-ac9440e0368f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (1a4eac95-9c30-4478-b3d6-8695df61d776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6f634337-2676-4c96-98f6-aea801e79133 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created volume successfully. Sep 03 11:05:47 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a 1073741824" returned: 0 in 0.614s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:48 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a Sep 03 11:05:48 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:48 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a" returned: 0 in 0.361s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:05:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730f103e-df0c-480e-a35c-3d5cf1e4810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a698925-1a34-41d3-96c7-2b48604afa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:05:48 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Volume volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a (06e05bf5-86c5-4533-94b5-ef6a3a66ad1a): created successfully Sep 03 11:05:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a698925-1a34-41d3-96c7-2b48604afa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:05:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Flow 'volume_create_manager' (1079a17b-def7-41c6-967b-1a2258d0c077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:05:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c20e0d6f-bda6-413e-97a0-d27eaefb7120 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created volume successfully. Sep 03 11:05:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-quobyte-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae281ba0-9ac8-4e95-93d4-293eaaee88cf]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:49 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a Sep 03 11:05:49 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:50 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a" returned: 0 in 0.700s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:50 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a Sep 03 11:05:50 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:50 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a" returned: 0 in 0.447s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a" released by "delete_volume" :: held 1.228s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created reservations ['68310dc5-1a35-47d7-9ff9-813bfe8f10e8', '6b77da1c-9b01-4df2-ac6f-1b20ec6d352f', '744a3228-bb72-4074-8676-88ed3d7bfe90', '3321811d-509f-42a2-9353-b37ebcbaa92b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:50 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:50 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:51 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.559s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:51 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:51 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Deleted volume successfully. Sep 03 11:05:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-10096b1e-6391-4828-aacf-bbd7579b45b0 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-06e05bf5-86c5-4533-94b5-ef6a3a66ad1a-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-dc8de185-8d88-415d-b87d-1441cebca66f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-dc8de185-8d88-415d-b87d-1441cebca66f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-quobyte-dc8de185-8d88-415d-b87d-1441cebca66f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-dc8de185-8d88-415d-b87d-1441cebca66f" acquired by "delete_volume" :: waited 0.035s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:52 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2a7483-c711-449f-9802-0a2b6bad0dc0]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:52 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f Sep 03 11:05:52 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:52 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f" returned: 0 in 0.636s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:52 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f Sep 03 11:05:52 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:53 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dc8de185-8d88-415d-b87d-1441cebca66f" returned: 0 in 0.525s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-dc8de185-8d88-415d-b87d-1441cebca66f" released by "delete_volume" :: held 1.375s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created reservations ['65a26fc7-65fe-4f4c-bbd9-758005b9fe0f', 'db98438c-3846-4d7d-af2d-d30587e945ab', 'c6454870-2a2b-4860-b92b-2f88a89495b9', '0638e1d8-268f-46f9-9649-dcaefbff6ba1'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:53 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:53 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:53 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.459s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:54 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Deleted volume successfully. Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1a0e0539-b5ee-4806-b264-7c863612120d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-dc8de185-8d88-415d-b87d-1441cebca66f-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-3906b606-6d91-49f1-b882-bf3190aab1ef-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-3906b606-6d91-49f1-b882-bf3190aab1ef-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-quobyte-3906b606-6d91-49f1-b882-bf3190aab1ef" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-3906b606-6d91-49f1-b882-bf3190aab1ef" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1718d15-dc0e-44c7-8184-bf5cdf509836]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:54 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef Sep 03 11:05:54 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:54 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef" returned: 0 in 0.493s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:54 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef Sep 03 11:05:54 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:55 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3906b606-6d91-49f1-b882-bf3190aab1ef" returned: 0 in 0.435s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-3906b606-6d91-49f1-b882-bf3190aab1ef" released by "delete_volume" :: held 0.985s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created reservations ['43419d2d-6098-4989-a98b-c59a2e8e6c3b', 'e13a63f4-d7da-4bc8-b023-c8ab47aeab7a', '325646e6-0f49-4c49-b3d5-e32a5b611632', '3bf7a3a8-8499-4946-af57-246a86acadab'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:55 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:55 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:55 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.369s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Deleted volume successfully. Sep 03 11:05:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9c3fd9b2-c9cd-402e-8a17-73d14dadcbf6 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-3906b606-6d91-49f1-b882-bf3190aab1ef-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-6b657457-91cf-4ff9-972b-14f75c1715f0-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-6b657457-91cf-4ff9-972b-14f75c1715f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-quobyte-6b657457-91cf-4ff9-972b-14f75c1715f0" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-6b657457-91cf-4ff9-972b-14f75c1715f0" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb099ca-3342-4ca6-8c27-ac73ebcf1d07]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:56 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0 Sep 03 11:05:56 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:57 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0" returned: 0 in 0.442s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:57 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0 Sep 03 11:05:57 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:57 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6b657457-91cf-4ff9-972b-14f75c1715f0" returned: 0 in 0.286s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-6b657457-91cf-4ff9-972b-14f75c1715f0" released by "delete_volume" :: held 0.789s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created reservations ['ad388404-acb4-44d6-ba23-35ce07beefca', 'abcb377d-aec7-4d51-bb51-0758e3b785d8', '8b0cce3d-7adc-4190-80b3-c91c1c3a46d7', '3255fb10-a6cd-4a75-8215-be72bcbc42fa'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:57 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:57 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-11c85b72-bfd8-46a8-a44f-4f992662e4be-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-11c85b72-bfd8-46a8-a44f-4f992662e4be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-quobyte-11c85b72-bfd8-46a8-a44f-4f992662e4be" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-11c85b72-bfd8-46a8-a44f-4f992662e4be" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdeb2c7-6b91-45d2-89eb-0424978de709]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:57 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.375s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Deleted volume successfully. Sep 03 11:05:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-405ef09a-b4e3-4cca-8ceb-2c138212135d tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-6b657457-91cf-4ff9-972b-14f75c1715f0-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:58 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be Sep 03 11:05:58 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:58 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be" returned: 0 in 0.430s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:58 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be Sep 03 11:05:58 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:58 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-11c85b72-bfd8-46a8-a44f-4f992662e4be" returned: 0 in 0.305s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-11c85b72-bfd8-46a8-a44f-4f992662e4be" released by "delete_volume" :: held 0.785s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created reservations ['65058f8a-af0e-4f33-9610-28d64b98d242', 'f596c414-a834-431a-a20d-2c33bab2982e', 'f0d6ef48-6acf-453c-b2f8-f4c80251b89b', '43c7dce2-cca6-4965-af9f-a50c88f7f74b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:58 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:05:58 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-855340ac-ad78-4aff-9ee2-1b3a16dab84f-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-855340ac-ad78-4aff-9ee2-1b3a16dab84f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-quobyte-86a14dfe-0092-4e09-977d-b3cc323033f4" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-86a14dfe-0092-4e09-977d-b3cc323033f4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-quobyte-855340ac-ad78-4aff-9ee2-1b3a16dab84f" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-855340ac-ad78-4aff-9ee2-1b3a16dab84f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Deleting offline snapshot 855340ac-ad78-4aff-9ee2-1b3a16dab84f of volume 86a14dfe-0092-4e09-977d-b3cc323033f4 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] snapshot_file for this snap is: volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2160ae8-1f3e-44e2-8eea-6ef96f141ed3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:59 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.312s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:05:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Deleted volume successfully. Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-bb7b73a3-323a-416c-8fac-37a7793c5af7 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-11c85b72-bfd8-46a8-a44f-4f992662e4be-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:05:59 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f Sep 03 11:05:59 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:59 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f" returned: 0 in 0.419s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86a14dfe-0092-4e09-977d-b3cc323033f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ce3923-8722-4a3c-8734-38248fda8b78]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:05:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:05:59 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 Sep 03 11:05:59 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:05:59 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4" returned: 0 in 0.464s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:00 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f Sep 03 11:06:00 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Flow 'volume_create_manager' (37b6d214-7fc7-4223-9556-a0f241f0df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d36095-56dc-406f-a633-26f359d96f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d36095-56dc-406f-a633-26f359d96f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-707150953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2c862d-145a-4779-82fa-6b0635c27211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee01b1ee3942e8949e64724f9cab87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:00Z,use_quota=True,user_id='7d0f038377f84d14b15656b2ce3955b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33ea818c-8185-4577-9f99-61f731a9036a),volume_type_id=33ea818c-8185-4577-9f99-61f731a9036a)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f3c7c7-8ba8-48f5-a9c3-667d5dff0173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f3c7c7-8ba8-48f5-a9c3-667d5dff0173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d991af-6f6e-4622-a843-9c03ba3feace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d991af-6f6e-4622-a843-9c03ba3feace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2c862d-145a-4779-82fa-6b0635c27211', 'volume_name': 'volume-2e2c862d-145a-4779-82fa-6b0635c27211', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302833d3-822b-4bda-8768-99655234dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302833d3-822b-4bda-8768-99655234dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2293770-f8b8-4da1-8e0f-2b3592c303cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Volume 2e2c862d-145a-4779-82fa-6b0635c27211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2c862d-145a-4779-82fa-6b0635c27211', 'volume_size': 1} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-707150953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2c862d-145a-4779-82fa-6b0635c27211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee01b1ee3942e8949e64724f9cab87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:00Z,use_quota=True,user_id='7d0f038377f84d14b15656b2ce3955b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33ea818c-8185-4577-9f99-61f731a9036a),volume_type_id=33ea818c-8185-4577-9f99-61f731a9036a)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Creating volume 2e2c862d-145a-4779-82fa-6b0635c27211 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:00 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:00 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211 1073741824 Sep 03 11:06:00 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:00 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f" returned: 0 in 0.541s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:00 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f Sep 03 11:06:00 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Flow 'volume_create_manager' (b20d0b3d-1575-488e-a739-9188c351ea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc5992d-d07d-4eba-babe-cb3cb00908e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211 1073741824" returned: 0 in 0.657s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc5992d-d07d-4eba-babe-cb3cb00908e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-335755187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692a1932-00a9-421e-9d8d-d31c22a3eabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307675d804364ee4896764a50d811fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:01Z,use_quota=True,user_id='e65bcf4ded1e4813a10bb3ce8a6af888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3757c5d9-8081-41f6-b22b-d76abb6804d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3757c5d9-8081-41f6-b22b-d76abb6804d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258aa6fb-20ce-4ea2-bef6-1a5a54fcc44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258aa6fb-20ce-4ea2-bef6-1a5a54fcc44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '692a1932-00a9-421e-9d8d-d31c22a3eabf', 'volume_name': 'volume-692a1932-00a9-421e-9d8d-d31c22a3eabf', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdfc9fb-bb41-4ba0-a36b-9fe1bac9b7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdfc9fb-bb41-4ba0-a36b-9fe1bac9b7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b87efd-4494-42f0-8c53-dcba4735dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Volume 692a1932-00a9-421e-9d8d-d31c22a3eabf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-692a1932-00a9-421e-9d8d-d31c22a3eabf', 'volume_size': 1} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:00 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Flow 'volume_create_manager' (703691a3-f2ab-4bc7-ad65-e7249797307b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6563514d-3375-41c3-9c46-c0e40d965edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4.855340ac-ad78-4aff-9ee2-1b3a16dab84f" returned: 0 in 0.421s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6563514d-3375-41c3-9c46-c0e40d965edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-260975381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6917eb-ad85-4122-bfec-da6ca96b3f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee01b1ee3942e8949e64724f9cab87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:01Z,use_quota=True,user_id='7d0f038377f84d14b15656b2ce3955b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dfed60c-0737-4bf6-801c-7bffdf19837f),volume_type_id=8dfed60c-0737-4bf6-801c-7bffdf19837f)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211 Sep 03 11:06:01 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ca7303-abf0-41b8-b9e1-1089a9179bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ca7303-abf0-41b8-b9e1-1089a9179bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f779b6-0ccc-49bd-b10f-f521d380cb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f779b6-0ccc-49bd-b10f-f521d380cb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6917eb-ad85-4122-bfec-da6ca96b3f37', 'volume_name': 'volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38feead7-2a8f-40da-8697-4999ca0a1b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38feead7-2a8f-40da-8697-4999ca0a1b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d24fce7-8f69-44f9-aabc-58cc5fb3b583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Volume 8b6917eb-ad85-4122-bfec-da6ca96b3f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37', 'volume_size': 1} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-855340ac-ad78-4aff-9ee2-1b3a16dab84f" released by "_delete_snapshot" :: held 2.059s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-86a14dfe-0092-4e09-977d-b3cc323033f4" released by "delete_snapshot" :: held 2.088s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created reservations ['04086b17-eeff-4702-8d19-93e8a2eb0ff2', '0171ecdf-a8e4-4755-af8b-557f5afc99c6', '40556cff-12d0-4acd-a5e6-9fa94992e754', 'e520b0a1-8c79-4101-bef7-58eb8b7e5753'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Delete snapshot completed successfully. Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9f05359a-2cf2-460c-ad3d-9d028aabfeda tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-855340ac-ad78-4aff-9ee2-1b3a16dab84f-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-86a14dfe-0092-4e09-977d-b3cc323033f4-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:01 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211" returned: 0 in 0.379s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-335755187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692a1932-00a9-421e-9d8d-d31c22a3eabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307675d804364ee4896764a50d811fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:01Z,use_quota=True,user_id='e65bcf4ded1e4813a10bb3ce8a6af888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Creating volume 692a1932-00a9-421e-9d8d-d31c22a3eabf {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:01 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:01 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf 1073741824 Sep 03 11:06:01 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-86a14dfe-0092-4e09-977d-b3cc323033f4-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2293770-f8b8-4da1-8e0f-2b3592c303cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2c862d-145a-4779-82fa-6b0635c27211', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e37a78-c4a0-4528-8d04-147221b0433b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Flow 'volume_create_manager' (43804028-3575-48d1-a4ff-e3e3d6a031d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ac9a92-5fbf-4125-a0c6-a281ac6bdc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Volume volume-2e2c862d-145a-4779-82fa-6b0635c27211 (2e2c862d-145a-4779-82fa-6b0635c27211): created successfully Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e37a78-c4a0-4528-8d04-147221b0433b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Flow 'volume_create_manager' (37b6d214-7fc7-4223-9556-a0f241f0df09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ac9a92-5fbf-4125-a0c6-a281ac6bdc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-926661003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff31702-5179-4e48-be4b-b46214bcf262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee01b1ee3942e8949e64724f9cab87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:01Z,use_quota=True,user_id='7d0f038377f84d14b15656b2ce3955b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d60896f-b06a-4299-b4bc-13f231e273c9),volume_type_id=8d60896f-b06a-4299-b4bc-13f231e273c9)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb217162-8c82-44ee-ad06-fd51f0b724b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb217162-8c82-44ee-ad06-fd51f0b724b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84ea837-230e-4956-a108-6dda97949e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:06:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f06d9f00-9b29-4d2a-bbee-2b9c81d6cf3c tempest-TestInstancesWithCinderVolumes-868937582 None] Created volume successfully. Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "cinder-quobyte-86a14dfe-0092-4e09-977d-b3cc323033f4" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-86a14dfe-0092-4e09-977d-b3cc323033f4" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19978ba-23f9-4b07-ac23-c894c0b4d02a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:01 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 Sep 03 11:06:01 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:01 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf 1073741824" returned: 0 in 0.484s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84ea837-230e-4956-a108-6dda97949e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ff31702-5179-4e48-be4b-b46214bcf262', 'volume_name': 'volume-7ff31702-5179-4e48-be4b-b46214bcf262', 'volume_size': 1, 'image_id': '53bfe973-d142-401b-9184-7eb5c45de149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53bfe973-d142-401b-9184-7eb5c45de149', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2057744215', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f5ee01b1ee3942e8949e64724f9cab87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '53bfe973-d142-401b-9184-7eb5c45de149', 'created_at': datetime.datetime(2026, 9, 3, 9, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 5, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53bfe973-d142-401b-9184-7eb5c45de149/file', 'properties': {}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97780e1-7673-460c-9289-c72aaeb69d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97780e1-7673-460c-9289-c72aaeb69d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a20c96-402e-4107-95c8-4d6fd50b981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Volume 7ff31702-5179-4e48-be4b-b46214bcf262: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ff31702-5179-4e48-be4b-b46214bcf262', 'volume_size': 1, 'image_id': '53bfe973-d142-401b-9184-7eb5c45de149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53bfe973-d142-401b-9184-7eb5c45de149', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2057744215', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f5ee01b1ee3942e8949e64724f9cab87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '53bfe973-d142-401b-9184-7eb5c45de149', 'created_at': datetime.datetime(2026, 9, 3, 9, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 5, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53bfe973-d142-401b-9184-7eb5c45de149/file', 'properties': {}}, 'image_service': } Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Trying to clone 7ff31702-5179-4e48-be4b-b46214bcf262 from image 53bfe973-d142-401b-9184-7eb5c45de149 at location (None, [{'url': 'file:///opt/stack/data/glance/images/53bfe973-d142-401b-9184-7eb5c45de149', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:06:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:01 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf Sep 03 11:06:01 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:02 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4" returned: 0 in 0.428s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:02 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4 Sep 03 11:06:02 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:02 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf" returned: 0 in 0.314s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-260975381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6917eb-ad85-4122-bfec-da6ca96b3f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee01b1ee3942e8949e64724f9cab87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:01Z,use_quota=True,user_id='7d0f038377f84d14b15656b2ce3955b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dfed60c-0737-4bf6-801c-7bffdf19837f),volume_type_id=8dfed60c-0737-4bf6-801c-7bffdf19837f)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Creating volume 8b6917eb-ad85-4122-bfec-da6ca96b3f37 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:02 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b87efd-4494-42f0-8c53-dcba4735dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-692a1932-00a9-421e-9d8d-d31c22a3eabf', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:02 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 1073741824 Sep 03 11:06:02 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b61016-75b5-4b05-919e-6e11a2ab17e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:02 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Volume volume-692a1932-00a9-421e-9d8d-d31c22a3eabf (692a1932-00a9-421e-9d8d-d31c22a3eabf): created successfully Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b61016-75b5-4b05-919e-6e11a2ab17e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Flow 'volume_create_manager' (b20d0b3d-1575-488e-a739-9188c351ea0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:02 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-86a14dfe-0092-4e09-977d-b3cc323033f4" returned: 0 in 0.293s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-quobyte-86a14dfe-0092-4e09-977d-b3cc323033f4" released by "delete_volume" :: held 0.788s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f614177b-0f35-4f27-83dc-e9c907c9083d tempest-VolumesListAdminTestJSON-125073830 None] Created volume successfully. Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Created reservations ['81b8806a-2258-4617-aed0-18ed9918e49a', 'a7988549-941b-4e03-b0d5-5f1822fd7ddf', '8faee888-ce2b-4400-9f4e-3cffc6f872c4', 'dc214513-b92b-46d0-845f-a7368b295691'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:02 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:02 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:02 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.282s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Deleted volume successfully. Sep 03 11:06:02 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 1073741824" returned: 0 in 0.574s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8e50e925-84f4-4f6d-915c-d5c3e50a44e4 tempest-CreateVolumesFromSnapshotTest-1394397531 None] Lock "cinder-86a14dfe-0092-4e09-977d-b3cc323033f4-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:02 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 Sep 03 11:06:02 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Flow 'volume_create_manager' (0b4986ac-221f-4bd5-91a5-a22e6d077c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200a95fb-4768-42f5-84cc-d5fa3aa69185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200a95fb-4768-42f5-84cc-d5fa3aa69185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-64592484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaff101a-12ea-4346-9593-2de49ea70f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307675d804364ee4896764a50d811fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:03Z,use_quota=True,user_id='e65bcf4ded1e4813a10bb3ce8a6af888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:03 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e2e505-85f4-4a09-8ccb-0f164a2a8ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e2e505-85f4-4a09-8ccb-0f164a2a8ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009d6bd2-b48c-437e-b029-8c9ff432f3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009d6bd2-b48c-437e-b029-8c9ff432f3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaff101a-12ea-4346-9593-2de49ea70f51', 'volume_name': 'volume-eaff101a-12ea-4346-9593-2de49ea70f51', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67110f7c-80e2-4ac4-bb31-9a7ffe10cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67110f7c-80e2-4ac4-bb31-9a7ffe10cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c888d22-26fe-4a33-9b79-a634626cfd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:03 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Volume eaff101a-12ea-4346-9593-2de49ea70f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaff101a-12ea-4346-9593-2de49ea70f51', 'volume_size': 1} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37" returned: 0 in 0.334s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-64592484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaff101a-12ea-4346-9593-2de49ea70f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307675d804364ee4896764a50d811fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:03Z,use_quota=True,user_id='e65bcf4ded1e4813a10bb3ce8a6af888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Creating volume eaff101a-12ea-4346-9593-2de49ea70f51 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:03 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d24fce7-8f69-44f9-aabc-58cc5fb3b583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:03 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51 1073741824 Sep 03 11:06:03 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03e2050-fb5a-45be-a1e8-ff44eb633f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:03 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Volume volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 (8b6917eb-ad85-4122-bfec-da6ca96b3f37): created successfully Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03e2050-fb5a-45be-a1e8-ff44eb633f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Flow 'volume_create_manager' (703691a3-f2ab-4bc7-ad65-e7249797307b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b6d2814c-a1a6-4e27-98cf-ac33f36b5139 tempest-TestInstancesWithCinderVolumes-868937582 None] Created volume successfully. Sep 03 11:06:03 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51 1073741824" returned: 0 in 0.570s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:03 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51 Sep 03 11:06:03 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:04 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51" returned: 0 in 0.292s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c888d22-26fe-4a33-9b79-a634626cfd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaff101a-12ea-4346-9593-2de49ea70f51', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642cb492-6045-4e8b-ae17-f95fb892661b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:04 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Volume volume-eaff101a-12ea-4346-9593-2de49ea70f51 (eaff101a-12ea-4346-9593-2de49ea70f51): created successfully Sep 03 11:06:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642cb492-6045-4e8b-ae17-f95fb892661b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Flow 'volume_create_manager' (0b4986ac-221f-4bd5-91a5-a22e6d077c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-cac4d1e2-9e8b-48d8-b575-9f5864f6770f tempest-VolumesListAdminTestJSON-125073830 None] Created volume successfully. Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Flow 'volume_create_manager' (fb1a0b1e-8ba0-4a3c-92ee-e549b0ccb1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a801fb46-ef45-481d-9fac-234d2a034283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a801fb46-ef45-481d-9fac-234d2a034283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-478430956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c440d4c5-734a-4622-b587-7214f032b25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307675d804364ee4896764a50d811fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:06Z,use_quota=True,user_id='e65bcf4ded1e4813a10bb3ce8a6af888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfccfb45-71f0-4288-8ae3-3dd907ba1721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfccfb45-71f0-4288-8ae3-3dd907ba1721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cfda82-f25c-4c40-aa33-265657664501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cfda82-f25c-4c40-aa33-265657664501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c440d4c5-734a-4622-b587-7214f032b25e', 'volume_name': 'volume-c440d4c5-734a-4622-b587-7214f032b25e', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a707c95b-1faf-488d-aa44-93be7d213e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a707c95b-1faf-488d-aa44-93be7d213e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe7861e-decb-4474-8595-1760c930ded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:06 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Volume c440d4c5-734a-4622-b587-7214f032b25e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c440d4c5-734a-4622-b587-7214f032b25e', 'volume_size': 1} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-478430956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c440d4c5-734a-4622-b587-7214f032b25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307675d804364ee4896764a50d811fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:06Z,use_quota=True,user_id='e65bcf4ded1e4813a10bb3ce8a6af888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Creating volume c440d4c5-734a-4622-b587-7214f032b25e {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:06 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:06 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e 1073741824 Sep 03 11:06:06 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD, size 20.69 MB, duration 4.67 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:06:06 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Image download 20.69 MB at 4.43 MB/s Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7068693-bc9e-4328-89bc-4cb5d17f816f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:06 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e 1073741824" returned: 0 in 0.532s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:06 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e Sep 03 11:06:06 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:06 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD Sep 03 11:06:06 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:07 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e" returned: 0 in 0.310s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe7861e-decb-4474-8595-1760c930ded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c440d4c5-734a-4622-b587-7214f032b25e', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad3b511-bf22-46c1-8f18-9c515e3c8d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:07 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Volume volume-c440d4c5-734a-4622-b587-7214f032b25e (c440d4c5-734a-4622-b587-7214f032b25e): created successfully Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad3b511-bf22-46c1-8f18-9c515e3c8d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Flow 'volume_create_manager' (fb1a0b1e-8ba0-4a3c-92ee-e549b0ccb1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:07 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Temporary image 53bfe973-d142-401b-9184-7eb5c45de149 is fetched for user 7d0f038377f84d14b15656b2ce3955b7. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:06:07 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-14ef21bd-7be5-401a-84d5-9beae920ebc9 tempest-VolumesListAdminTestJSON-125073830 None] Created volume successfully. Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d526f5a7-4166-4d25-b2be-bdff39ff890f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:07 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD Sep 03 11:06:07 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:07 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-926661003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff31702-5179-4e48-be4b-b46214bcf262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ee01b1ee3942e8949e64724f9cab87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:01Z,use_quota=True,user_id='7d0f038377f84d14b15656b2ce3955b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d60896f-b06a-4299-b4bc-13f231e273c9),volume_type_id=8d60896f-b06a-4299-b4bc-13f231e273c9)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Creating volume 7ff31702-5179-4e48-be4b-b46214bcf262 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:07 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:07 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 1073741824 Sep 03 11:06:07 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:08 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 1073741824" returned: 0 in 0.501s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:08 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 Sep 03 11:06:08 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:08 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262" returned: 0 in 0.320s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:08 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Attempting download of 53bfe973-d142-401b-9184-7eb5c45de149 ((None, [{'url': 'file:///opt/stack/data/glance/images/53bfe973-d142-401b-9184-7eb5c45de149', 'metadata': {}}])) to volume 7ff31702-5179-4e48-be4b-b46214bcf262. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:06:08 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[352d40f4-f367-40a7-a34f-0f72267695ca]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53bfe973-d142-401b-9184-7eb5c45de149_8w86vzvc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:08 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53bfe973-d142-401b-9184-7eb5c45de149_8w86vzvc Sep 03 11:06:08 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:09 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53bfe973-d142-401b-9184-7eb5c45de149_8w86vzvc" returned: 0 in 0.526s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53bfe973-d142-401b-9184-7eb5c45de149_8w86vzvc {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:09 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53bfe973-d142-401b-9184-7eb5c45de149_8w86vzvc Sep 03 11:06:09 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Flow 'volume_create_manager' (cc44e668-0fcc-4b02-940c-c822b94ae77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfe411b-0fb7-4eac-a707-823cc7f9239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfe411b-0fb7-4eac-a707-823cc7f9239d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b0dce3-403f-4f90-9280-4ba0c010ee3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a821144aa44997bac143524ad31541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:09Z,use_quota=True,user_id='a4df0f566cf9438db3f93341b9c37833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20d7011-62e8-4a35-ba70-3990560c72df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20d7011-62e8-4a35-ba70-3990560c72df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f28d785-fe74-4648-b298-1375bee58e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f28d785-fe74-4648-b298-1375bee58e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b0dce3-403f-4f90-9280-4ba0c010ee3c', 'volume_name': 'volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544154f2-1dc8-448a-9b98-20851d9faa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544154f2-1dc8-448a-9b98-20851d9faa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb394d1-5374-40d0-8fa8-15bd5e3cffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:09 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Volume 03b0dce3-403f-4f90-9280-4ba0c010ee3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c', 'volume_size': 1} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b0dce3-403f-4f90-9280-4ba0c010ee3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a821144aa44997bac143524ad31541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:09Z,use_quota=True,user_id='a4df0f566cf9438db3f93341b9c37833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Creating volume 03b0dce3-403f-4f90-9280-4ba0c010ee3c {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:09 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:09 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c 1073741824 Sep 03 11:06:09 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:09 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53bfe973-d142-401b-9184-7eb5c45de149_8w86vzvc" returned: 1 in 0.384s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53bfe973-d142-401b-9184-7eb5c45de149_8w86vzvc' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c625a879-b9e9-43f6-9a6e-916b37c4a80e]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:09 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD Sep 03 11:06:09 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:10 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] 53bfe973-d142-401b-9184-7eb5c45de149 was qcow2, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:10 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 Sep 03 11:06:10 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:10 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c 1073741824" returned: 0 in 0.685s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:10 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c Sep 03 11:06:10 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Flow 'volume_create_manager' (5127cac5-6a6b-4858-8947-fd89a9faabc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43522ae8-96eb-4b86-ae2f-64c8bf3a942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:10 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43522ae8-96eb-4b86-ae2f-64c8bf3a942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8f474a-440e-4e60-ad79-509d2c1d14e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8581f8ebc6fe483ea6341687b4143830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:10Z,use_quota=True,user_id='f45cb9aef3ff4bbcb2212e0afc3c44e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5db434e-a5be-4abc-9096-55e364e58209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5db434e-a5be-4abc-9096-55e364e58209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20915cb3-7b04-4655-a69f-8d30dbafe519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c" returned: 0 in 0.444s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb394d1-5374-40d0-8fa8-15bd5e3cffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1be8bc-8926-4b45-9c0c-9aa23a961765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:10 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Volume volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c (03b0dce3-403f-4f90-9280-4ba0c010ee3c): created successfully Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1be8bc-8926-4b45-9c0c-9aa23a961765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Flow 'volume_create_manager' (cc44e668-0fcc-4b02-940c-c822b94ae77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ab8d0b94-13d2-4a79-822e-55a04f825fd0 tempest-VolumesListAdminTestJSON-86678336 None] Created volume successfully. Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20915cb3-7b04-4655-a69f-8d30dbafe519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b8f474a-440e-4e60-ad79-509d2c1d14e6', 'volume_name': 'volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6', 'volume_size': 1, 'image_id': '7636f985-9f0b-493f-b560-39b5693be28e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7636f985-9f0b-493f-b560-39b5693be28e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4c22e1462e28fec3e43ea2bb09a0e6e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8581f8ebc6fe483ea6341687b4143830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f57c002bb79160923b22538ec96ed582b134cc91b263d2409624b21ef26df97a646f0ee1d2fd5467f73e66802c7c3f404f96f7188979d13b318dbee0221010f8', 'id': '7636f985-9f0b-493f-b560-39b5693be28e', 'created_at': datetime.datetime(2026, 9, 3, 9, 6, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 6, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7636f985-9f0b-493f-b560-39b5693be28e/file', 'properties': {}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295c55d1-01e9-4d45-8150-344490421633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295c55d1-01e9-4d45-8150-344490421633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94c394e-a84b-41ed-ad03-8a238f1734b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:11 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Volume 7b8f474a-440e-4e60-ad79-509d2c1d14e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6', 'volume_size': 1, 'image_id': '7636f985-9f0b-493f-b560-39b5693be28e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7636f985-9f0b-493f-b560-39b5693be28e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4c22e1462e28fec3e43ea2bb09a0e6e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8581f8ebc6fe483ea6341687b4143830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f57c002bb79160923b22538ec96ed582b134cc91b263d2409624b21ef26df97a646f0ee1d2fd5467f73e66802c7c3f404f96f7188979d13b318dbee0221010f8', 'id': '7636f985-9f0b-493f-b560-39b5693be28e', 'created_at': datetime.datetime(2026, 9, 3, 9, 6, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 6, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7636f985-9f0b-493f-b560-39b5693be28e/file', 'properties': {}}, 'image_service': } Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Trying to clone 7b8f474a-440e-4e60-ad79-509d2c1d14e6 from image 7636f985-9f0b-493f-b560-39b5693be28e at location (None, [{'url': 'file:///opt/stack/data/glance/images/7636f985-9f0b-493f-b560-39b5693be28e', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:06:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-3db77b51-6562-474d-9850-b6ebdde749ad req-55111159-a22a-4c99-93e9-14da7588f6f6 tempest-TestShelveInstance-1225470468 None] Terminate volume connection completed successfully. Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-3db77b51-6562-474d-9850-b6ebdde749ad req-55111159-a22a-4c99-93e9-14da7588f6f6 tempest-TestShelveInstance-1225470468 None] Deleting attachment 20e05686-f321-4d06-85b9-091a6ab73911. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:06:11 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Image download 0.00 MB at 0.00 MB/s Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e3f4e-d63d-448d-8827-a721967b1954]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:11 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD Sep 03 11:06:11 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Acquiring lock "cinder-03b0dce3-403f-4f90-9280-4ba0c010ee3c-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Lock "cinder-03b0dce3-403f-4f90-9280-4ba0c010ee3c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Acquiring lock "cinder-quobyte-03b0dce3-403f-4f90-9280-4ba0c010ee3c" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Lock "cinder-quobyte-03b0dce3-403f-4f90-9280-4ba0c010ee3c" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7650b864-0304-437f-bf1f-70d8b14f69fb]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "cinder-c440d4c5-734a-4622-b587-7214f032b25e-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-c440d4c5-734a-4622-b587-7214f032b25e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:11 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c Sep 03 11:06:11 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:11 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "cinder-quobyte-c440d4c5-734a-4622-b587-7214f032b25e" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-quobyte-c440d4c5-734a-4622-b587-7214f032b25e" acquired by "delete_volume" :: waited 0.051s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fa57b0-428c-41fe-bad1-0821a26de88b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:12 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD Sep 03 11:06:12 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:12 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e Sep 03 11:06:12 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:12 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c" returned: 0 in 0.548s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:12 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c Sep 03 11:06:12 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:12 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD" returned: 1 in 0.468s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Temporary image 7636f985-9f0b-493f-b560-39b5693be28e is fetched for user f45cb9aef3ff4bbcb2212e0afc3c44e0. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=146,cinder:UPDATE=212,cinder:INSERT=49,cinder:DELETE=22 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:06:12 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e" returned: 0 in 0.442s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a1dcb4-f93f-41f1-b7b7-3383bd93f5da]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:12 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e Sep 03 11:06:12 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:12 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262" returned: 0 in 2.607s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_53bfe973-d142-401b-9184-7eb5c45de149_l2wbfz0edevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:06:12 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Converted 112.00 MB image at 42.94 MB/s Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:12 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-03b0dce3-403f-4f90-9280-4ba0c010ee3c" returned: 0 in 0.408s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Lock "cinder-quobyte-03b0dce3-403f-4f90-9280-4ba0c010ee3c" released by "delete_volume" :: held 1.023s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:12 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 1G Sep 03 11:06:12 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:12 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD Sep 03 11:06:12 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Created reservations ['2a1d0149-dbff-475e-86e9-0a6970f56534', '7b0627ee-a43a-41a6-9a7f-0b911232c440', '0c8fed7d-6243-4cb7-81fc-1eaf780e8b4b', '46eab642-0fa7-4fe1-82e4-190166d03557'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:12 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c440d4c5-734a-4622-b587-7214f032b25e" returned: 0 in 0.392s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:12 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:12 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-quobyte-c440d4c5-734a-4622-b587-7214f032b25e" released by "delete_volume" :: held 0.917s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Created reservations ['3d32bce6-a864-41c2-a727-663fbbdf004d', '353a8199-7e4d-422b-83bb-77c0f10ded9a', '27973638-94cf-4f7a-8f32-2d2e825f16ed', '159cf66f-a73d-404d-a101-f481586c809c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:13 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:13 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 1G" returned: 0 in 0.502s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Downloaded image 53bfe973-d142-401b-9184-7eb5c45de149 ((None, [{'url': 'file:///opt/stack/data/glance/images/53bfe973-d142-401b-9184-7eb5c45de149', 'metadata': {}}])) to volume 7ff31702-5179-4e48-be4b-b46214bcf262 successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Temporary image 53bfe973-d142-401b-9184-7eb5c45de149 for user 7d0f038377f84d14b15656b2ce3955b7 is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Marking volume 7ff31702-5179-4e48-be4b-b46214bcf262 as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:13 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Copying metadata from image 53bfe973-d142-401b-9184-7eb5c45de149 to 7ff31702-5179-4e48-be4b-b46214bcf262. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Creating volume glance metadata for volume 7ff31702-5179-4e48-be4b-b46214bcf262 backed by image 53bfe973-d142-401b-9184-7eb5c45de149 with: {'image_id': '53bfe973-d142-401b-9184-7eb5c45de149', 'image_name': 'tempest-scenario-img--2057744215', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:06:13 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD Sep 03 11:06:13 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.333s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Deleted volume successfully. Sep 03 11:06:13 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:13 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d2c89c3e-1654-43c7-8d42-f8b62e6e344c tempest-VolumesListAdminTestJSON-86678336 None] Lock "cinder-03b0dce3-403f-4f90-9280-4ba0c010ee3c-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a20c96-402e-4107-95c8-4d6fd50b981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff31702-5179-4e48-be4b-b46214bcf262', 'volume_size': 1, 'image_id': '53bfe973-d142-401b-9184-7eb5c45de149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53bfe973-d142-401b-9184-7eb5c45de149', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2057744215', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f5ee01b1ee3942e8949e64724f9cab87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '53bfe973-d142-401b-9184-7eb5c45de149', 'created_at': datetime.datetime(2026, 9, 3, 9, 5, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 5, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53bfe973-d142-401b-9184-7eb5c45de149/file', 'properties': {}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e9f299-623e-4219-91a8-05227a262fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Volume volume-7ff31702-5179-4e48-be4b-b46214bcf262 (7ff31702-5179-4e48-be4b-b46214bcf262): created successfully Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e9f299-623e-4219-91a8-05227a262fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Flow 'volume_create_manager' (43804028-3575-48d1-a4ff-e3e3d6a031d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f19af3cb-d37b-4bf0-a6be-f144f89901d9 tempest-TestInstancesWithCinderVolumes-868937582 None] Created volume successfully. Sep 03 11:06:13 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8f474a-440e-4e60-ad79-509d2c1d14e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8581f8ebc6fe483ea6341687b4143830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:10Z,use_quota=True,user_id='f45cb9aef3ff4bbcb2212e0afc3c44e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Creating volume 7b8f474a-440e-4e60-ad79-509d2c1d14e6 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:13 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:13 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.364s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Deleted volume successfully. Sep 03 11:06:13 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 1073741824 Sep 03 11:06:13 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2ea29193-266d-47e5-b762-9dd8e7f7372f tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-c440d4c5-734a-4622-b587-7214f032b25e-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:14 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 1073741824" returned: 0 in 0.473s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:14 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 Sep 03 11:06:14 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "cinder-eaff101a-12ea-4346-9593-2de49ea70f51-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-eaff101a-12ea-4346-9593-2de49ea70f51-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "cinder-quobyte-eaff101a-12ea-4346-9593-2de49ea70f51" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-quobyte-eaff101a-12ea-4346-9593-2de49ea70f51" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:14 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6" returned: 0 in 0.299s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e4c15-6f3a-40b5-b2f8-b250852c9ad1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Attempting download of 7636f985-9f0b-493f-b560-39b5693be28e ((None, [{'url': 'file:///opt/stack/data/glance/images/7636f985-9f0b-493f-b560-39b5693be28e', 'metadata': {}}])) to volume 7b8f474a-440e-4e60-ad79-509d2c1d14e6. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d953a81-2387-45d1-b3a5-af902b46b907]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7636f985-9f0b-493f-b560-39b5693be28e_lhw_a3cf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:14 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51 Sep 03 11:06:14 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:14 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7636f985-9f0b-493f-b560-39b5693be28e_lhw_a3cf Sep 03 11:06:14 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-7437dca6-102b-410a-a8ca-7c0eded406b3 req-17c335cc-dde6-451b-a4ea-436d2604059d tempest-TestShelveInstance-1225470468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-7437dca6-102b-410a-a8ca-7c0eded406b3 req-17c335cc-dde6-451b-a4ea-436d2604059d tempest-TestShelveInstance-1225470468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-7437dca6-102b-410a-a8ca-7c0eded406b3 req-17c335cc-dde6-451b-a4ea-436d2604059d tempest-TestShelveInstance-1225470468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-7437dca6-102b-410a-a8ca-7c0eded406b3 req-17c335cc-dde6-451b-a4ea-436d2604059d tempest-TestShelveInstance-1225470468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '812475a1-42e6-4681-890d-268be12eef62', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:06:14 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51" returned: 0 in 0.541s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:14 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7636f985-9f0b-493f-b560-39b5693be28e_lhw_a3cf" returned: 0 in 0.474s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7636f985-9f0b-493f-b560-39b5693be28e_lhw_a3cf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:14 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51 Sep 03 11:06:14 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-7437dca6-102b-410a-a8ca-7c0eded406b3 req-17c335cc-dde6-451b-a4ea-436d2604059d tempest-TestShelveInstance-1225470468 None] attachment_update completed successfully. Sep 03 11:06:15 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7636f985-9f0b-493f-b560-39b5693be28e_lhw_a3cf Sep 03 11:06:15 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:15 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-eaff101a-12ea-4346-9593-2de49ea70f51" returned: 0 in 0.329s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-quobyte-eaff101a-12ea-4346-9593-2de49ea70f51" released by "delete_volume" :: held 0.939s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Created reservations ['ee6b57c9-20f4-4832-a7a6-d36785f6987a', '392b519d-5ab8-4d79-8f06-89b88d8bd3c3', 'e75c3cea-2876-44fb-8a24-90c5f8c89d08', 'c448d3ab-0ae5-4e16-8859-a5d3d8aa1c8c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:15 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7636f985-9f0b-493f-b560-39b5693be28e_lhw_a3cf" returned: 1 in 0.435s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7636f985-9f0b-493f-b560-39b5693be28e_lhw_a3cf' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de83589-9e21-4f35-9cc7-9c2454427c7c]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:15 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:15 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:15 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD Sep 03 11:06:15 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "cinder-692a1932-00a9-421e-9d8d-d31c22a3eabf-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-692a1932-00a9-421e-9d8d-d31c22a3eabf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "cinder-quobyte-692a1932-00a9-421e-9d8d-d31c22a3eabf" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-quobyte-692a1932-00a9-421e-9d8d-d31c22a3eabf" acquired by "delete_volume" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:15 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[79603e75-f4a3-48b1-b01e-95fcc509b99a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:15 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.458s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Deleted volume successfully. Sep 03 11:06:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9b646bb-c167-436c-9653-5c13daf2d8a7 tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-eaff101a-12ea-4346-9593-2de49ea70f51-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:16 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf Sep 03 11:06:16 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:16 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD Sep 03 11:06:16 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:16 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD" returned: 1 in 0.495s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:06:16 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] 7636f985-9f0b-493f-b560-39b5693be28e was raw, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:06:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:16 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 Sep 03 11:06:16 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:16 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf" returned: 0 in 0.591s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:16 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf Sep 03 11:06:16 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:16 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-692a1932-00a9-421e-9d8d-d31c22a3eabf" returned: 0 in 0.342s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-quobyte-692a1932-00a9-421e-9d8d-d31c22a3eabf" released by "delete_volume" :: held 1.035s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:16 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Created reservations ['de4a24ca-6000-4d44-902c-268cbc7297ec', '10abb666-7d94-4224-b119-ead5fa962a23', '5dc4cce5-9a04-40d9-9b0b-2d93c9cda40c', '6813534f-5093-4b1a-a942-5588823b5947'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:17 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:17 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:17 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6" returned: 0 in 0.777s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7636f985-9f0b-493f-b560-39b5693be28e_k83_1e4wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:06:17 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:17 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 1G Sep 03 11:06:17 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:17 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.370s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Deleted volume successfully. Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c5df5cd-9dc0-42b6-b2ef-b853cdaf386c tempest-VolumesListAdminTestJSON-125073830 None] Lock "cinder-692a1932-00a9-421e-9d8d-d31c22a3eabf-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:17 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 1G" returned: 0 in 0.455s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Downloaded image 7636f985-9f0b-493f-b560-39b5693be28e ((None, [{'url': 'file:///opt/stack/data/glance/images/7636f985-9f0b-493f-b560-39b5693be28e', 'metadata': {}}])) to volume 7b8f474a-440e-4e60-ad79-509d2c1d14e6 successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Temporary image 7636f985-9f0b-493f-b560-39b5693be28e for user f45cb9aef3ff4bbcb2212e0afc3c44e0 is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Marking volume 7b8f474a-440e-4e60-ad79-509d2c1d14e6 as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Copying metadata from image 7636f985-9f0b-493f-b560-39b5693be28e to 7b8f474a-440e-4e60-ad79-509d2c1d14e6. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Creating volume glance metadata for volume 7b8f474a-440e-4e60-ad79-509d2c1d14e6 backed by image 7636f985-9f0b-493f-b560-39b5693be28e with: {'image_id': '7636f985-9f0b-493f-b560-39b5693be28e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4c22e1462e28fec3e43ea2bb09a0e6e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94c394e-a84b-41ed-ad03-8a238f1734b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6', 'volume_size': 1, 'image_id': '7636f985-9f0b-493f-b560-39b5693be28e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7636f985-9f0b-493f-b560-39b5693be28e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4c22e1462e28fec3e43ea2bb09a0e6e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8581f8ebc6fe483ea6341687b4143830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f57c002bb79160923b22538ec96ed582b134cc91b263d2409624b21ef26df97a646f0ee1d2fd5467f73e66802c7c3f404f96f7188979d13b318dbee0221010f8', 'id': '7636f985-9f0b-493f-b560-39b5693be28e', 'created_at': datetime.datetime(2026, 9, 3, 9, 6, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 6, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7636f985-9f0b-493f-b560-39b5693be28e/file', 'properties': {}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bd436a-bbcf-4449-a2b4-b312ef4a21c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:17 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Volume volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 (7b8f474a-440e-4e60-ad79-509d2c1d14e6): created successfully Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bd436a-bbcf-4449-a2b4-b312ef4a21c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Flow 'volume_create_manager' (5127cac5-6a6b-4858-8947-fd89a9faabc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f89f9480-5844-4160-9451-cb9efabc33a6 tempest-VolumeImageDependencyTests-391381719 None] Created volume successfully. Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Acquiring lock "cinder-7b8f474a-440e-4e60-ad79-509d2c1d14e6-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-75656ffd-6700-402c-a049-40455a5656de req-d68e8227-cc82-4a90-81d2-b48c1455335a tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-75656ffd-6700-402c-a049-40455a5656de req-d68e8227-cc82-4a90-81d2-b48c1455335a tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Lock "cinder-7b8f474a-440e-4e60-ad79-509d2c1d14e6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-75656ffd-6700-402c-a049-40455a5656de req-d68e8227-cc82-4a90-81d2-b48c1455335a tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-75656ffd-6700-402c-a049-40455a5656de req-d68e8227-cc82-4a90-81d2-b48c1455335a tempest-TestInstancesWithCinderVolumes-868937582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-7ff31702-5179-4e48-be4b-b46214bcf262', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b45e622c-5ead-4405-bb55-077eb50cf088', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Acquiring lock "cinder-quobyte-7b8f474a-440e-4e60-ad79-509d2c1d14e6" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Lock "cinder-quobyte-7b8f474a-440e-4e60-ad79-509d2c1d14e6" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7535a9-4590-4280-95ca-d61cc5da1532]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-75656ffd-6700-402c-a049-40455a5656de req-d68e8227-cc82-4a90-81d2-b48c1455335a tempest-TestInstancesWithCinderVolumes-868937582 None] attachment_update completed successfully. Sep 03 11:06:18 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 Sep 03 11:06:18 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:19 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6" returned: 0 in 0.892s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:19 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6 Sep 03 11:06:19 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:20 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7b8f474a-440e-4e60-ad79-509d2c1d14e6" returned: 0 in 0.631s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Lock "cinder-quobyte-7b8f474a-440e-4e60-ad79-509d2c1d14e6" released by "delete_volume" :: held 1.597s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Created reservations ['986988cd-dabf-4750-a7b3-d0eea531d798', '3e199a5f-43fd-4693-aee7-2f974b907650', '40cbccc4-2981-4db3-a58a-9dece4a53bd6', '9c325917-d6e8-4e48-aea3-2ef0e9d694c4'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:20 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:20 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:20 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.397s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:20 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Deleted volume successfully. Sep 03 11:06:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-df0d55f1-dc8f-439b-a735-f1b79a1323d4 tempest-VolumeImageDependencyTests-391381719 None] Lock "cinder-7b8f474a-440e-4e60-ad79-509d2c1d14e6-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:06:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:23 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:23 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:24 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 1.061s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:24 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:24 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:06:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:06:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:06:30 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:INSERT=48,cinder:UPDATE=149,cinder:SELECT=136,cinder:DELETE=12 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:06:30 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=42,cinder:INSERT=21,cinder:UPDATE=50,cinder:DELETE=3 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Flow 'volume_create_manager' (61e62145-43f3-43af-b41d-7a26ee7bc509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (552ab35c-3665-4f48-b6ec-02ee84950dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (552ab35c-3665-4f48-b6ec-02ee84950dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785595471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae0ba6aec4514b3c2f2e534d394dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:47Z,use_quota=True,user_id='ca440bd3bf9b4786a37a3bb4043cefdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737382af-12e1-4147-9339-f09aec6ce83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737382af-12e1-4147-9339-f09aec6ce83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ffd900-9773-4a5c-8749-204909dfe18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ffd900-9773-4a5c-8749-204909dfe18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1', 'volume_name': 'volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b7bf8b-8a3b-40a1-96a4-3ba080f1d4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b7bf8b-8a3b-40a1-96a4-3ba080f1d4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a03662-ef11-46bb-9194-ada7d076fca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:46 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Volume 1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1', 'volume_size': 1} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785595471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae0ba6aec4514b3c2f2e534d394dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:47Z,use_quota=True,user_id='ca440bd3bf9b4786a37a3bb4043cefdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Creating volume 1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:46 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:46 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 1073741824 Sep 03 11:06:46 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:47 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 1073741824" returned: 0 in 0.516s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:47 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 Sep 03 11:06:47 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:47 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1" returned: 0 in 0.301s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a03662-ef11-46bb-9194-ada7d076fca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69072b97-ac2c-4fa5-96f1-2b4ac03fe48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:47 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Volume volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 (1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1): created successfully Sep 03 11:06:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69072b97-ac2c-4fa5-96f1-2b4ac03fe48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Flow 'volume_create_manager' (61e62145-43f3-43af-b41d-7a26ee7bc509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-25994fb7-694a-4ef0-84e0-c82c68a46061 tempest-ProjectReaderTests-1633020362 None] Created volume successfully. Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Acquiring lock "cinder-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Lock "cinder-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Acquiring lock "cinder-quobyte-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Lock "cinder-quobyte-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[549854b2-f5f0-4d0f-970d-2d3bc7f8aff5]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:49 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 Sep 03 11:06:49 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:49 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1" returned: 0 in 0.417s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:49 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1 Sep 03 11:06:49 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:49 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Lock "cinder-quobyte-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1" released by "delete_volume" :: held 0.719s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Created reservations ['05182485-bef1-4da8-a960-7a9bd437de40', 'cc9a5ff3-7d9a-4986-848e-487bcc1ae1d4', '2688afae-6254-4eac-8f83-2d0f3d485464', '64983f35-b681-47fe-8ea9-bcbc74fc96b7'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:49 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:49 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:50 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.274s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:50 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Deleted volume successfully. Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fe845185-f5b2-42cb-b1b6-59f592b6f1dc tempest-ProjectReaderTests-1633020362 None] Lock "cinder-1bfdee54-ac66-49ed-a5a9-cfbf1ecf51f1-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Flow 'volume_create_manager' (333aaf5d-c956-4975-9408-0b904798ec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b9c438-11ac-4196-bc13-2bdddcca6a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b9c438-11ac-4196-bc13-2bdddcca6a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603303929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be7e674-ba93-49d7-8853-39585d134e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae0ba6aec4514b3c2f2e534d394dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:51Z,use_quota=True,user_id='ca440bd3bf9b4786a37a3bb4043cefdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e85e318-e275-486d-9966-1643464524b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e85e318-e275-486d-9966-1643464524b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cb57dd-7579-46a6-8dbb-2bc8c895fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cb57dd-7579-46a6-8dbb-2bc8c895fb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be7e674-ba93-49d7-8853-39585d134e92', 'volume_name': 'volume-0be7e674-ba93-49d7-8853-39585d134e92', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541e10ee-92d5-4cbf-9d76-70ecf3cf1ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541e10ee-92d5-4cbf-9d76-70ecf3cf1ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63058df8-3662-4363-8844-ac5fd6f58d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:50 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Volume 0be7e674-ba93-49d7-8853-39585d134e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be7e674-ba93-49d7-8853-39585d134e92', 'volume_size': 1} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603303929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be7e674-ba93-49d7-8853-39585d134e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae0ba6aec4514b3c2f2e534d394dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:51Z,use_quota=True,user_id='ca440bd3bf9b4786a37a3bb4043cefdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Creating volume 0be7e674-ba93-49d7-8853-39585d134e92 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:50 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:50 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92 1073741824 Sep 03 11:06:50 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:51 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92 1073741824" returned: 0 in 0.458s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:51 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92 Sep 03 11:06:51 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:51 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63058df8-3662-4363-8844-ac5fd6f58d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be7e674-ba93-49d7-8853-39585d134e92', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69401cee-8f74-42e8-ae04-1fc9da2df106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:51 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Volume volume-0be7e674-ba93-49d7-8853-39585d134e92 (0be7e674-ba93-49d7-8853-39585d134e92): created successfully Sep 03 11:06:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69401cee-8f74-42e8-ae04-1fc9da2df106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Flow 'volume_create_manager' (333aaf5d-c956-4975-9408-0b904798ec13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:51 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f76d4a50-8d41-4e47-8815-df19e5c954ab tempest-ProjectReaderTests-1633020362 None] Created volume successfully. Sep 03 11:06:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "cinder-0be7e674-ba93-49d7-8853-39585d134e92-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Lock "cinder-0be7e674-ba93-49d7-8853-39585d134e92-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "cinder-quobyte-0be7e674-ba93-49d7-8853-39585d134e92" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Lock "cinder-quobyte-0be7e674-ba93-49d7-8853-39585d134e92" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d22fc6-effc-4388-a5f2-8b7972fe8205]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:53 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92 Sep 03 11:06:53 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:53 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92" returned: 0 in 0.455s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:53 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92 Sep 03 11:06:53 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:53 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0be7e674-ba93-49d7-8853-39585d134e92" returned: 0 in 0.270s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Lock "cinder-quobyte-0be7e674-ba93-49d7-8853-39585d134e92" released by "delete_volume" :: held 0.790s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Created reservations ['e6e3cbc7-6b98-4a4e-9371-4ab247e5453b', '24bbedf8-8bf7-4ba7-a46e-e2c11e5b4c44', 'b89e9a34-f500-4eb9-b543-72410bdafd3f', '10d47278-9a0f-4348-834a-c81b8246a6ee'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:54 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:54 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Flow 'volume_create_manager' (6613058c-3e02-4510-b972-1796e596eff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ed8252-92b6-4d1a-b436-3be5851e898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ed8252-92b6-4d1a-b436-3be5851e898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1920206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5418a6ba-7403-42b2-bb69-d1d47a546115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942bdc468a494a3289309ac0ac3b012c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:54Z,use_quota=True,user_id='83d79b97e9ba4776a95b869c7bd5b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6968c2-b3cb-416f-8f6d-1a37c100db15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6968c2-b3cb-416f-8f6d-1a37c100db15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d6c130-6745-4877-97b0-6d298ad926c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d6c130-6745-4877-97b0-6d298ad926c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5418a6ba-7403-42b2-bb69-d1d47a546115', 'volume_name': 'volume-5418a6ba-7403-42b2-bb69-d1d47a546115', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c8e1e2-d8c4-4517-8104-25af537fae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c8e1e2-d8c4-4517-8104-25af537fae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d15c4f5-04e1-4c02-a2ea-35b1b17e42b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:54 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Volume 5418a6ba-7403-42b2-bb69-d1d47a546115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5418a6ba-7403-42b2-bb69-d1d47a546115', 'volume_size': 1} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1920206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5418a6ba-7403-42b2-bb69-d1d47a546115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='942bdc468a494a3289309ac0ac3b012c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:54Z,use_quota=True,user_id='83d79b97e9ba4776a95b869c7bd5b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Creating volume 5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:54 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:54 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 1073741824 Sep 03 11:06:54 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:54 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.308s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:54 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Deleted volume successfully. Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-586c58d2-9172-46af-a0d0-13b51a1a7cc9 tempest-ProjectReaderTests-1633020362 None] Lock "cinder-0be7e674-ba93-49d7-8853-39585d134e92-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:54 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 1073741824" returned: 0 in 0.579s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:54 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 Sep 03 11:06:54 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Flow 'volume_create_manager' (b8e85673-0b06-4bfd-afaa-dcb84216b201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80d44e4-634e-4fd3-87e7-c59dc11cedd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80d44e4-634e-4fd3-87e7-c59dc11cedd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299741236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ed1da0-065a-425e-8c73-9f487a6d257d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae0ba6aec4514b3c2f2e534d394dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:55Z,use_quota=True,user_id='ca440bd3bf9b4786a37a3bb4043cefdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc56427-f9af-4eee-be31-6290581932a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc56427-f9af-4eee-be31-6290581932a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16756c49-d2eb-4992-935a-70eb8eb3c2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16756c49-d2eb-4992-935a-70eb8eb3c2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ed1da0-065a-425e-8c73-9f487a6d257d', 'volume_name': 'volume-16ed1da0-065a-425e-8c73-9f487a6d257d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4144ec-6c1b-464d-8722-93344550fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4144ec-6c1b-464d-8722-93344550fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a7a2bf-9162-4757-afff-4c826768819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Volume 16ed1da0-065a-425e-8c73-9f487a6d257d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ed1da0-065a-425e-8c73-9f487a6d257d', 'volume_size': 1} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:55 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115" returned: 0 in 0.293s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.065s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299741236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ed1da0-065a-425e-8c73-9f487a6d257d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae0ba6aec4514b3c2f2e534d394dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:55Z,use_quota=True,user_id='ca440bd3bf9b4786a37a3bb4043cefdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Creating volume 16ed1da0-065a-425e-8c73-9f487a6d257d {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:55 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d15c4f5-04e1-4c02-a2ea-35b1b17e42b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5418a6ba-7403-42b2-bb69-d1d47a546115', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:55 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d 1073741824 Sep 03 11:06:55 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10182e78-8e4e-4723-8d4d-f8f04c0c03db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Volume volume-5418a6ba-7403-42b2-bb69-d1d47a546115 (5418a6ba-7403-42b2-bb69-d1d47a546115): created successfully Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10182e78-8e4e-4723-8d4d-f8f04c0c03db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Flow 'volume_create_manager' (6613058c-3e02-4510-b972-1796e596eff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-991327e2-16f8-44f5-b0d7-f0d35e10e91b tempest-VolumesActionsTest-1393901842 None] Created volume successfully. Sep 03 11:06:55 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d 1073741824" returned: 0 in 0.453s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:55 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d Sep 03 11:06:55 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:55 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a7a2bf-9162-4757-afff-4c826768819e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ed1da0-065a-425e-8c73-9f487a6d257d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce8774-d522-433b-860c-2ae0c237a2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Volume volume-16ed1da0-065a-425e-8c73-9f487a6d257d (16ed1da0-065a-425e-8c73-9f487a6d257d): created successfully Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce8774-d522-433b-860c-2ae0c237a2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Flow 'volume_create_manager' (b8e85673-0b06-4bfd-afaa-dcb84216b201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b79b9063-68af-4a8b-879a-897e4fb0a00b tempest-ProjectReaderTests-1633020362 None] Created volume successfully. Sep 03 11:06:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "cinder-16ed1da0-065a-425e-8c73-9f487a6d257d-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Lock "cinder-16ed1da0-065a-425e-8c73-9f487a6d257d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "cinder-quobyte-16ed1da0-065a-425e-8c73-9f487a6d257d" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Lock "cinder-quobyte-16ed1da0-065a-425e-8c73-9f487a6d257d" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c37487-578f-46e0-b7a2-0f088f652579]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:57 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d Sep 03 11:06:57 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-84be2eff-a8f9-4e2a-985d-4175678ff6e6 req-52e926e2-acd7-4454-bdaf-f1fd7e68b0eb tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-84be2eff-a8f9-4e2a-985d-4175678ff6e6 req-52e926e2-acd7-4454-bdaf-f1fd7e68b0eb tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-84be2eff-a8f9-4e2a-985d-4175678ff6e6 req-52e926e2-acd7-4454-bdaf-f1fd7e68b0eb tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-84be2eff-a8f9-4e2a-985d-4175678ff6e6 req-52e926e2-acd7-4454-bdaf-f1fd7e68b0eb tempest-TestInstancesWithCinderVolumes-868937582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-2e2c862d-145a-4779-82fa-6b0635c27211', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c3551b2-ac27-4c63-a4c8-7b88ad3932ce', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:06:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-84be2eff-a8f9-4e2a-985d-4175678ff6e6 req-52e926e2-acd7-4454-bdaf-f1fd7e68b0eb tempest-TestInstancesWithCinderVolumes-868937582 None] attachment_update completed successfully. Sep 03 11:06:57 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d" returned: 0 in 0.420s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:57 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d Sep 03 11:06:57 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:57 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-16ed1da0-065a-425e-8c73-9f487a6d257d" returned: 0 in 0.307s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Lock "cinder-quobyte-16ed1da0-065a-425e-8c73-9f487a6d257d" released by "delete_volume" :: held 0.788s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Created reservations ['b89fec15-f42a-41a0-87f8-9ae54a138db8', '03aca8bf-f253-4765-92cd-8f355d6eab08', '5b096b96-7492-46b5-a185-266bb4f08fb7', '60269243-4eca-4956-8031-594303cda6bf'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:58 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:06:58 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:58 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.296s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:58 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Deleted volume successfully. Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e704c04-73d7-4f71-9361-0a56eae27b15 tempest-ProjectReaderTests-1633020362 None] Lock "cinder-16ed1da0-065a-425e-8c73-9f487a6d257d-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Flow 'volume_create_manager' (1e6971c3-3f94-4fe0-9421-fcff87c1ab7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3b0449-3559-4337-98b1-09dbc4a6b97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3b0449-3559-4337-98b1-09dbc4a6b97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1060472598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb6b1c8-b1fd-41d4-956f-77ad90802581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae0ba6aec4514b3c2f2e534d394dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:59Z,use_quota=True,user_id='ca440bd3bf9b4786a37a3bb4043cefdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de3fbdc-6d23-4c2b-80e3-c460a9592733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de3fbdc-6d23-4c2b-80e3-c460a9592733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14902dad-377f-4584-8ca9-594da279b62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14902dad-377f-4584-8ca9-594da279b62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb6b1c8-b1fd-41d4-956f-77ad90802581', 'volume_name': 'volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662e694f-543d-4376-b989-85fa2fc4c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662e694f-543d-4376-b989-85fa2fc4c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d2388e-0f99-4ad9-b3da-065faba89f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:58 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Volume 7eb6b1c8-b1fd-41d4-956f-77ad90802581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581', 'volume_size': 1} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1060472598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb6b1c8-b1fd-41d4-956f-77ad90802581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae0ba6aec4514b3c2f2e534d394dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:06:59Z,use_quota=True,user_id='ca440bd3bf9b4786a37a3bb4043cefdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Creating volume 7eb6b1c8-b1fd-41d4-956f-77ad90802581 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:06:58 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:06:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:58 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 1073741824 Sep 03 11:06:58 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:59 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 1073741824" returned: 0 in 0.683s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:59 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 Sep 03 11:06:59 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:59 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581" returned: 0 in 0.352s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:06:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:06:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d2388e-0f99-4ad9-b3da-065faba89f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:06:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0cb126-af47-4a0e-8513-7e15ae726b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:06:59 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Volume volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 (7eb6b1c8-b1fd-41d4-956f-77ad90802581): created successfully Sep 03 11:07:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0cb126-af47-4a0e-8513-7e15ae726b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:07:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Flow 'volume_create_manager' (1e6971c3-3f94-4fe0-9421-fcff87c1ab7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:07:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d5de2416-35b8-4c0d-95aa-1d2533b291e1 tempest-ProjectReaderTests-1633020362 None] Created volume successfully. Sep 03 11:07:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-a5b47d05-78eb-4fb2-8227-51cdc049af6e req-c6197b70-9cd5-4c2c-9f29-5bd13442d9a4 tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-a5b47d05-78eb-4fb2-8227-51cdc049af6e req-c6197b70-9cd5-4c2c-9f29-5bd13442d9a4 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-a5b47d05-78eb-4fb2-8227-51cdc049af6e req-c6197b70-9cd5-4c2c-9f29-5bd13442d9a4 tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:07:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-a5b47d05-78eb-4fb2-8227-51cdc049af6e req-c6197b70-9cd5-4c2c-9f29-5bd13442d9a4 tempest-TestInstancesWithCinderVolumes-868937582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0c0f421-58ff-4764-bb93-c4b5f3046784', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:07:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-a5b47d05-78eb-4fb2-8227-51cdc049af6e req-c6197b70-9cd5-4c2c-9f29-5bd13442d9a4 tempest-TestInstancesWithCinderVolumes-868937582 None] attachment_update completed successfully. Sep 03 11:07:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Acquiring lock "cinder-7eb6b1c8-b1fd-41d4-956f-77ad90802581-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Lock "cinder-7eb6b1c8-b1fd-41d4-956f-77ad90802581-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Acquiring lock "cinder-quobyte-7eb6b1c8-b1fd-41d4-956f-77ad90802581" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Lock "cinder-quobyte-7eb6b1c8-b1fd-41d4-956f-77ad90802581" acquired by "delete_volume" :: waited 0.046s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:01 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30b4908-f89e-43a1-ad71-7847009aa2d7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:07:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:01 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 Sep 03 11:07:01 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:02 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581" returned: 0 in 0.893s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:02 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581 Sep 03 11:07:02 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:02 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eb6b1c8-b1fd-41d4-956f-77ad90802581" returned: 0 in 0.368s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Lock "cinder-quobyte-7eb6b1c8-b1fd-41d4-956f-77ad90802581" released by "delete_volume" :: held 1.346s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Created reservations ['a9ee362c-a751-4952-b915-a23e7885bd03', '0b2a2db2-6979-4139-8c2f-d8582ff35e57', '0839faaa-8e01-4f9b-81e3-328a0409a5c8', 'e9d71cd8-1aad-4161-9c80-a5c9b0956b54'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:07:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:03 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:07:03 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:03 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.523s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:03 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:07:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Deleted volume successfully. Sep 03 11:07:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-9d58a51b-26c1-46b5-83b4-2a8298e38c8f tempest-ProjectReaderTests-1633020362 None] Lock "cinder-7eb6b1c8-b1fd-41d4-956f-77ad90802581-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-2d5277f8-c53d-41a5-95f8-33fad88f90a6 tempest-TestShelveInstance-1225470468 None] Terminate volume connection completed successfully. Sep 03 11:07:03 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-2d5277f8-c53d-41a5-95f8-33fad88f90a6 tempest-TestShelveInstance-1225470468 None] Deleting attachment 812475a1-42e6-4681-890d-268be12eef62. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:07:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Acquiring lock "cinder-6cdc942a-72a1-4c42-943f-f0dad46bdc91-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Lock "cinder-6cdc942a-72a1-4c42-943f-f0dad46bdc91-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Acquiring lock "cinder-quobyte-6cdc942a-72a1-4c42-943f-f0dad46bdc91" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Lock "cinder-quobyte-6cdc942a-72a1-4c42-943f-f0dad46bdc91" acquired by "delete_volume" :: waited 0.044s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:04 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b35b0cd-074f-4778-9b27-8049299208ec]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:07:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:04 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 Sep 03 11:07:04 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:05 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91" returned: 0 in 0.809s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:05 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91 Sep 03 11:07:05 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:05 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cdc942a-72a1-4c42-943f-f0dad46bdc91" returned: 0 in 0.375s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Lock "cinder-quobyte-6cdc942a-72a1-4c42-943f-f0dad46bdc91" released by "delete_volume" :: held 1.295s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:05 devstack cinder-volume[86603]: DEBUG cinder.quota [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Created reservations ['5992c580-a572-4a7e-a463-76fd5f97fdd6', '3fe55353-e87b-4e3a-8532-b0bda2bed22b', 'aeef9c58-267a-45c6-a624-71b3f7ad7bc2', '3191504f-438c-4beb-a490-7d4a2b8f8be1'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:07:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:07:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:07:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:07:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:06 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:07:06 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.804s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:06 devstack cinder-volume[86603]: DEBUG cinder.manager [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:07:06 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:06 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Deleted volume successfully. Sep 03 11:07:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [req-48783682-0a09-4b7f-b3d4-5c8c54eb46f9 req-1d694ea1-58e9-499a-a96b-26ee719e069a tempest-TestShelveInstance-1225470468 None] Lock "cinder-6cdc942a-72a1-4c42-943f-f0dad46bdc91-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c7ce920b-9559-40be-84d3-0432f8ad452f tempest-VolumesActionsTest-1393901842 None] Acquiring lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115" by "attach_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c7ce920b-9559-40be-84d3-0432f8ad452f tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115" acquired by "attach_volume" :: waited 0.040s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c7ce920b-9559-40be-84d3-0432f8ad452f tempest-VolumesActionsTest-1393901842 None] Attaching volume 5418a6ba-7403-42b2-bb69-d1d47a546115 to instance f6cf0768-8954-49bb-b9c6-fa5ad9050b73 at mountpoint /dev/vdb on host None. Sep 03 11:07:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c7ce920b-9559-40be-84d3-0432f8ad452f tempest-VolumesActionsTest-1393901842 None] Attach volume completed successfully. Sep 03 11:07:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c7ce920b-9559-40be-84d3-0432f8ad452f tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115" released by "attach_volume" :: held 0.187s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c452381-07f0-4ccc-9634-e0cef0885648 tempest-VolumesActionsTest-1393901842 None] Acquiring lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115-detach_volume" by "detach_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c452381-07f0-4ccc-9634-e0cef0885648 tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4c452381-07f0-4ccc-9634-e0cef0885648 tempest-VolumesActionsTest-1393901842 None] Detaching volume 5418a6ba-7403-42b2-bb69-d1d47a546115 from instance f6cf0768-8954-49bb-b9c6-fa5ad9050b73. Sep 03 11:07:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4c452381-07f0-4ccc-9634-e0cef0885648 tempest-VolumesActionsTest-1393901842 None] Detach volume completed successfully. Sep 03 11:07:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4c452381-07f0-4ccc-9634-e0cef0885648 tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-a5f4e03b-7820-4d01-9999-7e2be6180bf1 req-7d49e4ae-acbd-4c8b-8528-aafe28297312 tempest-TestInstancesWithCinderVolumes-868937582 None] Terminate volume connection completed successfully. Sep 03 11:07:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-a5f4e03b-7820-4d01-9999-7e2be6180bf1 req-7d49e4ae-acbd-4c8b-8528-aafe28297312 tempest-TestInstancesWithCinderVolumes-868937582 None] Deleting attachment 6c3551b2-ac27-4c63-a4c8-7b88ad3932ce. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:07:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "cinder-2e2c862d-145a-4779-82fa-6b0635c27211-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-2e2c862d-145a-4779-82fa-6b0635c27211-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "cinder-quobyte-2e2c862d-145a-4779-82fa-6b0635c27211" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-quobyte-2e2c862d-145a-4779-82fa-6b0635c27211" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[153c3b43-e5b3-478e-adbf-b57e7d42bf51]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:07:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:10 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211 Sep 03 11:07:10 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:10 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211" returned: 0 in 0.556s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:10 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211 Sep 03 11:07:10 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:11 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2e2c862d-145a-4779-82fa-6b0635c27211" returned: 0 in 0.321s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-quobyte-2e2c862d-145a-4779-82fa-6b0635c27211" released by "delete_volume" :: held 0.949s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:11 devstack cinder-volume[86603]: WARNING cinder.quota [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872559618-506959668 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872559618-506959668, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:07:11 devstack cinder-volume[86603]: WARNING cinder.quota [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872559618-506959668 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872559618-506959668, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Created reservations ['2ca5c3a4-4936-447f-8413-6591ef8d6486', '272c2f11-2426-46f1-916c-6a66451035b6', '8f2083cf-ca9d-4695-b96c-15f39223a7f2', 'f460e0e3-0dbe-4a91-b102-f31680607745'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:11 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:07:11 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:11 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.369s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:07:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Deleted volume successfully. Sep 03 11:07:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0d2b0d01-ccad-4124-a324-348c347d336a tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-2e2c862d-145a-4779-82fa-6b0635c27211-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-4f3a39ae-ced4-4839-9242-2c8d763c329b req-a3883145-08b5-4cda-b88b-585db27b76ec tempest-TestInstancesWithCinderVolumes-868937582 None] Terminate volume connection completed successfully. Sep 03 11:07:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-4f3a39ae-ced4-4839-9242-2c8d763c329b req-a3883145-08b5-4cda-b88b-585db27b76ec tempest-TestInstancesWithCinderVolumes-868937582 None] Deleting attachment b0c0f421-58ff-4764-bb93-c4b5f3046784. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:07:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "cinder-8b6917eb-ad85-4122-bfec-da6ca96b3f37-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-8b6917eb-ad85-4122-bfec-da6ca96b3f37-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "cinder-quobyte-8b6917eb-ad85-4122-bfec-da6ca96b3f37" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-quobyte-8b6917eb-ad85-4122-bfec-da6ca96b3f37" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[052ac0b1-319c-4dbf-b628-fe0d44758c14]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:07:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:15 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 Sep 03 11:07:15 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:15 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37" returned: 0 in 0.590s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:15 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37 Sep 03 11:07:15 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:16 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8b6917eb-ad85-4122-bfec-da6ca96b3f37" returned: 0 in 0.374s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-quobyte-8b6917eb-ad85-4122-bfec-da6ca96b3f37" released by "delete_volume" :: held 1.033s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:16 devstack cinder-volume[86603]: WARNING cinder.quota [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-907022388-666220899 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-907022388-666220899, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:07:16 devstack cinder-volume[86603]: WARNING cinder.quota [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-907022388-666220899 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-907022388-666220899, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Created reservations ['b293572d-a206-43d1-a0b3-36e1550b25e0', '60bc46d3-0cc6-4589-8409-a6ff6ef0fd65', '7826c628-4dd3-42bd-bd40-9ecf2ffac44f', '4bb31027-7b24-4514-a7b5-5b0a28581e50'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:16 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:07:16 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:16 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:07:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Deleted volume successfully. Sep 03 11:07:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a7ca460c-9522-4516-8f67-7b9d7b4982fd tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-8b6917eb-ad85-4122-bfec-da6ca96b3f37-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:22 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-b54e08d9-b4a7-43b7-8ffa-9bff8254d913 req-2dfd5834-8426-4c74-a926-6fd56f3d170b tempest-TestInstancesWithCinderVolumes-868937582 None] Terminate volume connection completed successfully. Sep 03 11:07:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-b54e08d9-b4a7-43b7-8ffa-9bff8254d913 req-2dfd5834-8426-4c74-a926-6fd56f3d170b tempest-TestInstancesWithCinderVolumes-868937582 None] Deleting attachment b45e622c-5ead-4405-bb55-077eb50cf088. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:23 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:07:23 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:23 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.433s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "cinder-7ff31702-5179-4e48-be4b-b46214bcf262-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-7ff31702-5179-4e48-be4b-b46214bcf262-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "cinder-quobyte-7ff31702-5179-4e48-be4b-b46214bcf262" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-quobyte-7ff31702-5179-4e48-be4b-b46214bcf262" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fee18a-27d6-40ff-b723-ee8a6929e2af]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:07:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:24 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 Sep 03 11:07:24 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad601b52-8ba3-447e-b0c7-8a46b2dd53ac tempest-VolumesActionsTest-1393901842 None] Acquiring lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115" by "attach_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:24 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262" returned: 0 in 0.590s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad601b52-8ba3-447e-b0c7-8a46b2dd53ac tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115" acquired by "attach_volume" :: waited 0.040s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:24 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262 Sep 03 11:07:24 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:24 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ad601b52-8ba3-447e-b0c7-8a46b2dd53ac tempest-VolumesActionsTest-1393901842 None] Attaching volume 5418a6ba-7403-42b2-bb69-d1d47a546115 to instance 8f7da278-78f9-465a-a7d3-bab898f26877 at mountpoint /dev/vdb on host None. Sep 03 11:07:24 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ad601b52-8ba3-447e-b0c7-8a46b2dd53ac tempest-VolumesActionsTest-1393901842 None] Attach volume completed successfully. Sep 03 11:07:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad601b52-8ba3-447e-b0c7-8a46b2dd53ac tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115" released by "attach_volume" :: held 0.151s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:25 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7ff31702-5179-4e48-be4b-b46214bcf262" returned: 0 in 0.424s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-quobyte-7ff31702-5179-4e48-be4b-b46214bcf262" released by "delete_volume" :: held 1.091s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:25 devstack cinder-volume[86603]: WARNING cinder.quota [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2097284048-1538995870 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2097284048-1538995870, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:07:25 devstack cinder-volume[86603]: WARNING cinder.quota [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2097284048-1538995870 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2097284048-1538995870, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c3a31c3f-f7c6-4425-b414-4dfb61032e8d tempest-VolumesActionsTest-1393901842 None] Acquiring lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115-detach_volume" by "detach_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Created reservations ['954bd88b-6311-4186-9123-e69f7080dd43', '8fa998a5-4ad8-4b1a-ab18-c32a7c6855d2', '3e9afdeb-177f-4a05-a1c1-7c7144f33d29', 'eb06e8c9-bad4-49f6-aaea-7f14dc4e843b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c3a31c3f-f7c6-4425-b414-4dfb61032e8d tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:07:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c3a31c3f-f7c6-4425-b414-4dfb61032e8d tempest-VolumesActionsTest-1393901842 None] Detaching volume 5418a6ba-7403-42b2-bb69-d1d47a546115 from instance 8f7da278-78f9-465a-a7d3-bab898f26877. Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c3a31c3f-f7c6-4425-b414-4dfb61032e8d tempest-VolumesActionsTest-1393901842 None] Detach volume completed successfully. Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c3a31c3f-f7c6-4425-b414-4dfb61032e8d tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:25 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:07:25 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:25 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.369s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:07:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Deleted volume successfully. Sep 03 11:07:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ed10ae12-7bf4-478c-bccb-c4132565475e tempest-TestInstancesWithCinderVolumes-868937582 None] Lock "cinder-7ff31702-5179-4e48-be4b-b46214bcf262-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:07:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:30 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a371c3d4-6c96-4328-b1f9-87e39d14f7fd]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:07:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:30 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 Sep 03 11:07:30 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:30 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115" returned: 0 in 0.363s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:30 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db9fd00-58c7-4d83-be5f-91ca11e45a74]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:07:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:30 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 Sep 03 11:07:30 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:31 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115" returned: 0 in 0.384s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.a409a0ba-e378-4e75-a445-963a286ce8556ukiyixc.img {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:31 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.a409a0ba-e378-4e75-a445-963a286ce8556ukiyixc.img Sep 03 11:07:31 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:37 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.a409a0ba-e378-4e75-a445-963a286ce8556ukiyixc.img" returned: 0 in 5.874s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:37 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[355d037b-e35f-4ef6-b899-5476234e6fee]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:07:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:37 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 Sep 03 11:07:37 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:07:37 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 03 11:07:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115" returned: 0 in 0.630s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:07:37 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.a409a0ba-e378-4e75-a445-963a286ce8556ukiyixc.img {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:07:37 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Converted 1024.00 MB image at 174.30 MB/s Sep 03 11:07:37 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] a409a0ba-e378-4e75-a445-963a286ce855 was raw, no need to convert to raw {{(pid=86603) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 11:07:42 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=94,cinder:SELECT=84,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:07:47 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=80,cinder:INSERT=22,cinder:UPDATE=83,cinder:DELETE=8 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Flow 'volume_create_manager' (615a3284-23d7-4321-b4cf-2c9ad3bacaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1db19e-9b21-46f3-a5f7-27a2ac59d45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1db19e-9b21-46f3-a5f7-27a2ac59d45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89150c0d-bec1-4337-8e35-9a3108f8c007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d455cd8db943f7ae7e85ff1cbe2f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:07:48Z,use_quota=True,user_id='3cad3eeeea1e4a87a0c5bcee48861b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891832cb-65d4-4da8-9153-f1fb61bbc05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891832cb-65d4-4da8-9153-f1fb61bbc05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a6bb55-2355-416c-947d-6c6096edbe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a6bb55-2355-416c-947d-6c6096edbe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89150c0d-bec1-4337-8e35-9a3108f8c007', 'volume_name': 'volume-89150c0d-bec1-4337-8e35-9a3108f8c007', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b0fba2-b398-4d17-9b2a-47eea8fed036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b0fba2-b398-4d17-9b2a-47eea8fed036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa67fd3-c3ac-4a2b-ba34-5303de0487a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:48 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Volume 89150c0d-bec1-4337-8e35-9a3108f8c007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89150c0d-bec1-4337-8e35-9a3108f8c007', 'volume_size': 1} Sep 03 11:07:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Flow 'volume_create_manager' (beff4763-1864-4df8-9f78-8ad6b022a177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4eee8a8-91f1-44c2-a6b3-8f1b922f0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4eee8a8-91f1-44c2-a6b3-8f1b922f0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1462941607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e25a09-cbda-4e7d-8dba-93fca8aec279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1697aaec004c45abe4af7ac159c9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:07:52Z,use_quota=True,user_id='4742b6eba3d5497f9b81707b06fda6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b6bb64-d5ef-4f61-bb41-a34f8e44c4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b6bb64-d5ef-4f61-bb41-a34f8e44c4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6367e2-9f97-4afb-ae96-f9912f0196dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6367e2-9f97-4afb-ae96-f9912f0196dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62e25a09-cbda-4e7d-8dba-93fca8aec279', 'volume_name': 'volume-62e25a09-cbda-4e7d-8dba-93fca8aec279', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a0339d-eb24-4cc0-adbb-8038d8d14d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a0339d-eb24-4cc0-adbb-8038d8d14d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87299ccc-f7ac-44ea-8954-16e86e6ccb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:07:52 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Volume 62e25a09-cbda-4e7d-8dba-93fca8aec279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62e25a09-cbda-4e7d-8dba-93fca8aec279', 'volume_size': 1} Sep 03 11:07:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.417s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Uploaded volume to glance image-id: a409a0ba-e378-4e75-a445-963a286ce855. {{(pid=86603) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.663s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89150c0d-bec1-4337-8e35-9a3108f8c007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d455cd8db943f7ae7e85ff1cbe2f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:07:48Z,use_quota=True,user_id='3cad3eeeea1e4a87a0c5bcee48861b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Creating volume 89150c0d-bec1-4337-8e35-9a3108f8c007 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:07:59 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:07:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:07:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ba3f05e4-9628-44e9-b015-b30468200f91 tempest-VolumesActionsTest-1393901842 None] Copy volume to image completed successfully. Sep 03 11:07:59 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007 1073741824 Sep 03 11:07:59 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:00 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007 1073741824" returned: 0 in 0.419s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:00 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007 Sep 03 11:08:00 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:00 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007" returned: 0 in 0.257s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.372s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1462941607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e25a09-cbda-4e7d-8dba-93fca8aec279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1697aaec004c45abe4af7ac159c9d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:07:52Z,use_quota=True,user_id='4742b6eba3d5497f9b81707b06fda6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Creating volume 62e25a09-cbda-4e7d-8dba-93fca8aec279 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:08:00 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:00 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 1073741824 Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa67fd3-c3ac-4a2b-ba34-5303de0487a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89150c0d-bec1-4337-8e35-9a3108f8c007', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:00 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7a01a8-0cce-419f-9bd0-77030729b08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:08:00 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Volume volume-89150c0d-bec1-4337-8e35-9a3108f8c007 (89150c0d-bec1-4337-8e35-9a3108f8c007): created successfully Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7a01a8-0cce-419f-9bd0-77030729b08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Flow 'volume_create_manager' (615a3284-23d7-4321-b4cf-2c9ad3bacaec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:08:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-865d872a-8935-464f-8316-02301c8c995b tempest-CinderUnicodeTest-2031935231 None] Created volume successfully. Sep 03 11:08:01 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 1073741824" returned: 0 in 0.529s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:01 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 Sep 03 11:08:01 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:08:01 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Flow 'volume_create_manager' (ac349cc3-2b5e-4bc9-9bb8-b523964a184a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb30a314-6b23-49c3-b3d3-c9d27c43fbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279" returned: 0 in 0.303s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb30a314-6b23-49c3-b3d3-c9d27c43fbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:08:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1313184461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d50dbe-6087-42ed-abf2-5b4714f894eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d455cd8db943f7ae7e85ff1cbe2f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:08:01Z,use_quota=True,user_id='3cad3eeeea1e4a87a0c5bcee48861b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7df8404-aec9-4fee-a8b3-36c18a55b30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7df8404-aec9-4fee-a8b3-36c18a55b30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197e7904-58aa-4717-bb95-c111a33f9bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197e7904-58aa-4717-bb95-c111a33f9bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d50dbe-6087-42ed-abf2-5b4714f894eb', 'volume_name': 'volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5bec4a-d6eb-4b8b-8f8a-7e58ed17eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5bec4a-d6eb-4b8b-8f8a-7e58ed17eb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86844ff8-e510-4bd0-9113-29d10e22fb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:08:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Volume d0d50dbe-6087-42ed-abf2-5b4714f894eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb', 'volume_size': 1} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:08:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1313184461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d50dbe-6087-42ed-abf2-5b4714f894eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d455cd8db943f7ae7e85ff1cbe2f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:08:01Z,use_quota=True,user_id='3cad3eeeea1e4a87a0c5bcee48861b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Creating volume d0d50dbe-6087-42ed-abf2-5b4714f894eb {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:08:01 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87299ccc-f7ac-44ea-8954-16e86e6ccb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e25a09-cbda-4e7d-8dba-93fca8aec279', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51337f3c-45a3-4eb6-9dd7-fa3f49835dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:08:01 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb 1073741824 Sep 03 11:08:01 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Volume volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 (62e25a09-cbda-4e7d-8dba-93fca8aec279): created successfully Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51337f3c-45a3-4eb6-9dd7-fa3f49835dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Flow 'volume_create_manager' (beff4763-1864-4df8-9f78-8ad6b022a177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:08:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7050da91-f133-4376-b8eb-96843c2a2520 tempest-TestImageHashVerification-182909160 None] Created volume successfully. Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:01 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb 1073741824" returned: 0 in 0.460s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:02 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb Sep 03 11:08:02 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:02 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb" returned: 0 in 0.245s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.463s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86844ff8-e510-4bd0-9113-29d10e22fb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08721c46-e675-4bd6-bd01-27000d2cd3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7e491b-ab51-4c71-bb5f-fdd44e6781c0]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:02 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Volume volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb (d0d50dbe-6087-42ed-abf2-5b4714f894eb): created successfully Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08721c46-e675-4bd6-bd01-27000d2cd3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Flow 'volume_create_manager' (ac349cc3-2b5e-4bc9-9bb8-b523964a184a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:08:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-932849c7-c919-4cf7-a8a4-f974149812ed tempest-CinderUnicodeTest-2031935231 None] Created volume successfully. Sep 03 11:08:02 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 Sep 03 11:08:02 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:02 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115" returned: 0 in 0.414s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a903fe25-89d7-44ae-af80-3d158ccb0cd1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:02 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 Sep 03 11:08:02 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:03 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115" returned: 0 in 0.360s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:03 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img Sep 03 11:08:03 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:07 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img" returned: 0 in 4.325s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f6f4f3-3338-4302-8f39-be77cd30f7d9]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:07 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 Sep 03 11:08:07 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:07 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115" returned: 0 in 0.509s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:07 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:08:07 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Converted 1024.00 MB image at 236.69 MB/s Sep 03 11:08:07 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] d5ab5c04-fcbb-439c-9d12-e4ea141ab147 was raw, converting to qcow2 {{(pid=86603) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 03 11:08:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bedd4ff-dffd-4393-89b1-dabde82aaf77]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:08 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img Sep 03 11:08:08 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:08 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img" returned: 0 in 0.318s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:08 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img Sep 03 11:08:08 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:08 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img" returned: 1 in 0.313s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:08:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img /opt/stack/data/cinder/conversion/vol_upload_jrjq38kw {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:08 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img /opt/stack/data/cinder/conversion/vol_upload_jrjq38kw Sep 03 11:08:08 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:08 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img /opt/stack/data/cinder/conversion/vol_upload_jrjq38kw" returned: 0 in 0.260s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:08 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Image conversion details: src /opt/stack/data/cinder/conversion/5418a6ba-7403-42b2-bb69-d1d47a546115.temp_image.d5ab5c04-fcbb-439c-9d12-e4ea141ab1478bj_b1p6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jrjq38kw {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:08:08 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 03 11:08:08 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ed1b9-df11-46d5-afce-d3ed1ea7e265]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jrjq38kw {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:08 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jrjq38kw Sep 03 11:08:08 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:09 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jrjq38kw" returned: 0 in 0.314s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.085s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:10 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Uploaded volume to glance image-id: d5ab5c04-fcbb-439c-9d12-e4ea141ab147. {{(pid=86603) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 11:08:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.591s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1100b110-9438-499b-9572-e2b420d9ec6a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-36a6db2f-5f28-4512-8d1a-54e1351ada5a tempest-VolumesActionsTest-1393901842 None] Copy volume to image completed successfully. Sep 03 11:08:10 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 Sep 03 11:08:10 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:10 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279" returned: 0 in 0.355s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[19093ee2-2137-47a9-a0b8-95f3cfad1866]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:10 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 Sep 03 11:08:10 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:11 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279" returned: 0 in 0.370s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 /opt/stack/data/cinder/conversion/62e25a09-cbda-4e7d-8dba-93fca8aec279.temp_image.2eef5eec-7aba-496b-8188-83aeaef3d2a089y99sdq.img {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:11 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 /opt/stack/data/cinder/conversion/62e25a09-cbda-4e7d-8dba-93fca8aec279.temp_image.2eef5eec-7aba-496b-8188-83aeaef3d2a089y99sdq.img Sep 03 11:08:11 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Acquiring lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Acquiring lock "cinder-quobyte-5418a6ba-7403-42b2-bb69-d1d47a546115" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Lock "cinder-quobyte-5418a6ba-7403-42b2-bb69-d1d47a546115" acquired by "delete_volume" :: waited 0.035s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f91b16-f008-4a2b-8aa2-ff5fbbe2201a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:13 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 Sep 03 11:08:13 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:14 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115" returned: 0 in 1.217s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:14 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115 Sep 03 11:08:14 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:14 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5418a6ba-7403-42b2-bb69-d1d47a546115" returned: 0 in 0.525s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Lock "cinder-quobyte-5418a6ba-7403-42b2-bb69-d1d47a546115" released by "delete_volume" :: held 1.836s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Created reservations ['7b8d18f6-c5cb-49b9-8e80-9467a9902ab6', 'a93d7ce8-3b00-4e4a-9f93-2cfdd56a3740', 'b6458204-3779-490b-85ea-74bcd446bfd3', '54e316ee-2659-47a6-919b-cfff79babe39'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:14 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:08:14 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:15 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.431s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:15 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:08:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Deleted volume successfully. Sep 03 11:08:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c9c7c307-3b63-484b-a013-945938212145 tempest-VolumesActionsTest-1393901842 None] Lock "cinder-5418a6ba-7403-42b2-bb69-d1d47a546115-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:15 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 /opt/stack/data/cinder/conversion/62e25a09-cbda-4e7d-8dba-93fca8aec279.temp_image.2eef5eec-7aba-496b-8188-83aeaef3d2a089y99sdq.img" returned: 0 in 4.574s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c63f39-de71-4011-a777-0601916c8ac7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:15 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 Sep 03 11:08:15 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:16 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279" returned: 0 in 0.593s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:16 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279, size 1024.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/conversion/62e25a09-cbda-4e7d-8dba-93fca8aec279.temp_image.2eef5eec-7aba-496b-8188-83aeaef3d2a089y99sdq.img {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:08:16 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Converted 1024.00 MB image at 223.80 MB/s Sep 03 11:08:16 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] 2eef5eec-7aba-496b-8188-83aeaef3d2a0 was raw, no need to convert to raw {{(pid=86603) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:23 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:08:23 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:23 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.296s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:08:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:08:26 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=19,cinder:UPDATE=16,cinder:DELETE=3,cinder:INSERT=2 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:08:26 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:08:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.971s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Uploaded volume to glance image-id: 2eef5eec-7aba-496b-8188-83aeaef3d2a0. {{(pid=86603) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 11:08:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 33.201s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Creating offline snapshot 1c14e047-899d-45cc-b329-103214639654 of volume d0d50dbe-6087-42ed-abf2-5b4714f894eb {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:08:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f1627a14-b59a-4667-a232-5059fb6aa379 tempest-TestImageHashVerification-182909160 None] Copy volume to image completed successfully. Sep 03 11:08:37 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc863bf8-9687-4ce9-b8c9-566273283599]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:37 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb Sep 03 11:08:37 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:37 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb" returned: 0 in 0.414s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:37 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 1G Sep 03 11:08:37 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:38 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 1G" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:38 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 Sep 03 11:08:38 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:38 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654" returned: 0 in 0.332s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:38 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 is being set with open permissions: ugo+rw Sep 03 11:08:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:38 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 Sep 03 11:08:38 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:38 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654" returned: 0 in 0.309s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:39 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.info Sep 03 11:08:39 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Acquiring lock "cinder-62e25a09-cbda-4e7d-8dba-93fca8aec279-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Lock "cinder-62e25a09-cbda-4e7d-8dba-93fca8aec279-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Acquiring lock "cinder-quobyte-62e25a09-cbda-4e7d-8dba-93fca8aec279" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Lock "cinder-quobyte-62e25a09-cbda-4e7d-8dba-93fca8aec279" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b8be48-d2ff-4ad8-b29a-22c2a3770778]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:39 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.info" returned: 0 in 0.350s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:39 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.info is being set with open permissions: ugo+rw Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:39 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.info Sep 03 11:08:39 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:39 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 Sep 03 11:08:39 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:39 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.info" returned: 0 in 0.277s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ab10c05f-7595-4abd-99d8-1e28320b48b8 tempest-CinderUnicodeTest-2031935231 None] Create snapshot completed successfully Sep 03 11:08:39 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279" returned: 0 in 0.413s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:39 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279 Sep 03 11:08:39 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:39 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-62e25a09-cbda-4e7d-8dba-93fca8aec279" returned: 0 in 0.282s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Lock "cinder-quobyte-62e25a09-cbda-4e7d-8dba-93fca8aec279" released by "delete_volume" :: held 0.746s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "cinder-1c14e047-899d-45cc-b329-103214639654-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Created reservations ['f311a9f0-f22d-4216-8c10-da3029fc8dbd', '2b71204f-45f6-4e2b-bf30-77f01128d76c', '1379a1df-84a6-4266-b990-ae7622481914', 'e4cac032-a86b-46c5-b8ee-ee27fd740c0c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-1c14e047-899d-45cc-b329-103214639654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "cinder-quobyte-d0d50dbe-6087-42ed-abf2-5b4714f894eb" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-quobyte-d0d50dbe-6087-42ed-abf2-5b4714f894eb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "cinder-quobyte-1c14e047-899d-45cc-b329-103214639654" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-quobyte-1c14e047-899d-45cc-b329-103214639654" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Deleting offline snapshot 1c14e047-899d-45cc-b329-103214639654 of volume d0d50dbe-6087-42ed-abf2-5b4714f894eb {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] snapshot_file for this snap is: volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0eba0-0b85-4807-9b20-496b5cad416c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:40 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:08:40 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:40 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 Sep 03 11:08:40 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:40 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.303s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:08:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Deleted volume successfully. Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ea2d40ff-afb7-45e0-a64c-86715dd3d43a tempest-TestImageHashVerification-182909160 None] Lock "cinder-62e25a09-cbda-4e7d-8dba-93fca8aec279-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:40 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654" returned: 0 in 0.465s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3abda26-83e3-4430-8683-40288fcfe07e]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:40 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb Sep 03 11:08:40 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:41 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb" returned: 0 in 0.409s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:41 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 Sep 03 11:08:41 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:41 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654" returned: 0 in 0.435s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:41 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654 Sep 03 11:08:41 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:41 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb.1c14e047-899d-45cc-b329-103214639654" returned: 0 in 0.299s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-quobyte-1c14e047-899d-45cc-b329-103214639654" released by "_delete_snapshot" :: held 1.747s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-quobyte-d0d50dbe-6087-42ed-abf2-5b4714f894eb" released by "delete_snapshot" :: held 1.778s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:41 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Created reservations ['a062f2e8-8c2e-4d6a-a73b-f18f231c991b', '07f0a40f-cd7f-48ea-a119-992917e04dac', '36c19ec0-1510-4210-b176-63cdc11ac094', '46fdf1b7-447f-4a10-b3f2-6b732d515dae'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:08:42 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Delete snapshot completed successfully. Sep 03 11:08:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-18328c0f-bc32-4fbb-9120-3819e93323d0 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-1c14e047-899d-45cc-b329-103214639654-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "cinder-d0d50dbe-6087-42ed-abf2-5b4714f894eb-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-d0d50dbe-6087-42ed-abf2-5b4714f894eb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "cinder-quobyte-d0d50dbe-6087-42ed-abf2-5b4714f894eb" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-quobyte-d0d50dbe-6087-42ed-abf2-5b4714f894eb" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:42 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[deac7671-68b9-47fa-87e7-66e010bc5678]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:42 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb Sep 03 11:08:42 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:42 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb" returned: 0 in 0.436s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:42 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb Sep 03 11:08:42 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:43 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d0d50dbe-6087-42ed-abf2-5b4714f894eb" returned: 0 in 0.308s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-quobyte-d0d50dbe-6087-42ed-abf2-5b4714f894eb" released by "delete_volume" :: held 0.823s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Created reservations ['d9c8360d-bf38-4894-b19c-bac6a9ed71bf', '161b14a8-ef89-44f9-8aba-e8a47fc104a5', 'f493c126-94b9-427d-b28d-6fbc7543e46d', 'f44a4c5e-5e9f-4617-9e67-524f68f99fe4'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:43 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:08:43 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "cinder-89150c0d-bec1-4337-8e35-9a3108f8c007-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-89150c0d-bec1-4337-8e35-9a3108f8c007-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "cinder-quobyte-89150c0d-bec1-4337-8e35-9a3108f8c007" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-quobyte-89150c0d-bec1-4337-8e35-9a3108f8c007" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bf24bc-b767-47ee-a157-935da9ee98ed]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:43 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.387s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:08:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Deleted volume successfully. Sep 03 11:08:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0aa56b00-4e83-4cd7-9a89-943378c6c880 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-d0d50dbe-6087-42ed-abf2-5b4714f894eb-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:43 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007 Sep 03 11:08:43 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:44 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007" returned: 0 in 0.526s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:44 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007 Sep 03 11:08:44 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:44 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-89150c0d-bec1-4337-8e35-9a3108f8c007" returned: 0 in 0.416s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-quobyte-89150c0d-bec1-4337-8e35-9a3108f8c007" released by "delete_volume" :: held 1.004s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Created reservations ['80a51f5f-fdb1-4f15-bd73-175cdecc0ff7', '234b73a6-65bd-4ceb-8f0f-3ef8b07d16f6', 'd6a68f92-d151-4253-b28c-0db7229974bb', '4b7975d1-2b33-41e0-b3fc-7b4a24e6e56f'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:08:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:44 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:08:44 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:45 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.335s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:45 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:08:45 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Deleted volume successfully. Sep 03 11:08:45 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cb755219-a8c5-47b0-b56f-4287be4350d4 tempest-CinderUnicodeTest-2031935231 None] Lock "cinder-89150c0d-bec1-4337-8e35-9a3108f8c007-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:08:54 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:08:55 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=24,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Flow 'volume_create_manager' (f17a0f54-5ac9-4488-8845-f844252262cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6584e67-22b4-4e75-9c42-7fe182d71bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6584e67-22b4-4e75-9c42-7fe182d71bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-278330518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddafe2584c049c7be2242c1a50244d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:09:11Z,use_quota=True,user_id='c256bfcb9c494d13b8a85130483ebda2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f417be83-2ac7-4697-9bb9-fcd05e3b7cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f417be83-2ac7-4697-9bb9-fcd05e3b7cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a2ac5a-d9e8-400b-a583-20997c321ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a2ac5a-d9e8-400b-a583-20997c321ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d', 'volume_name': 'volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64840821-e189-4a6f-8a60-1f0eb8595ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64840821-e189-4a6f-8a60-1f0eb8595ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f5e228-5a0a-4b70-a59a-4adf605719c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:11 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Volume 9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d', 'volume_size': 1} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-278330518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddafe2584c049c7be2242c1a50244d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:09:11Z,use_quota=True,user_id='c256bfcb9c494d13b8a85130483ebda2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Creating volume 9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:09:11 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:09:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:11 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d 1073741824 Sep 03 11:09:11 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:09:12 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Flow 'volume_create_manager' (a97aa7d9-7f3a-497e-a949-2041cea2c712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f61b67-d45d-45d1-b3e0-b26a51ddb67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d 1073741824" returned: 0 in 0.986s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f61b67-d45d-45d1-b3e0-b26a51ddb67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1305450362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05153ebd-d4ba-432d-8506-a87211081878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38fea1a90b84d47b9f95c1500cc468c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:09:12Z,use_quota=True,user_id='fb9c51d530164467812817e7d16f444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd3aacf-8b5f-44be-b70a-ad0a82ccbd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd3aacf-8b5f-44be-b70a-ad0a82ccbd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b49c361-e77e-45df-9c67-a6d24acf00b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b49c361-e77e-45df-9c67-a6d24acf00b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05153ebd-d4ba-432d-8506-a87211081878', 'volume_name': 'volume-05153ebd-d4ba-432d-8506-a87211081878', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66e3409-1a07-48ec-ba93-3d151240a279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66e3409-1a07-48ec-ba93-3d151240a279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f297f8-5c54-4d2f-a3d3-4f135ad6b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:12 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Volume 05153ebd-d4ba-432d-8506-a87211081878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05153ebd-d4ba-432d-8506-a87211081878', 'volume_size': 1} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:12 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d Sep 03 11:09:12 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:13 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" returned: 0 in 0.389s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1305450362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05153ebd-d4ba-432d-8506-a87211081878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38fea1a90b84d47b9f95c1500cc468c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:09:12Z,use_quota=True,user_id='fb9c51d530164467812817e7d16f444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Creating volume 05153ebd-d4ba-432d-8506-a87211081878 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:09:13 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f5e228-5a0a-4b70-a59a-4adf605719c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb550bd-0767-4ecf-9919-4dbe6dbdda00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:13 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878 1073741824 Sep 03 11:09:13 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Volume volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d (9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d): created successfully Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb550bd-0767-4ecf-9919-4dbe6dbdda00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Flow 'volume_create_manager' (f17a0f54-5ac9-4488-8845-f844252262cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:09:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b4f4925e-afe3-4814-ac7f-0fa96cb739e2 tempest-SnapshotDependencyTests-28953100 None] Created volume successfully. Sep 03 11:09:13 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878 1073741824" returned: 0 in 0.915s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:14 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878 Sep 03 11:09:14 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:14 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878" returned: 0 in 0.530s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.481s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f297f8-5c54-4d2f-a3d3-4f135ad6b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05153ebd-d4ba-432d-8506-a87211081878', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81712b0d-5419-4d0b-83ab-0bf41f0332ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Creating offline snapshot 9a591d26-4cca-4d6b-8954-4422c61a2a12 of volume 9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:09:14 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Volume volume-05153ebd-d4ba-432d-8506-a87211081878 (05153ebd-d4ba-432d-8506-a87211081878): created successfully Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81712b0d-5419-4d0b-83ab-0bf41f0332ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Flow 'volume_create_manager' (a97aa7d9-7f3a-497e-a949-2041cea2c712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e98d0f2-d4b9-4d62-8878-77931fc4a2ba]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:09:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-85413f7f-1be9-4ce9-8a00-0b94dd316e3b tempest-TestMinimumBasicScenario-244082232 None] Created volume successfully. Sep 03 11:09:14 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d Sep 03 11:09:14 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:15 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" returned: 0 in 0.494s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:15 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 1G Sep 03 11:09:15 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:15 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 1G" returned: 0 in 0.495s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:15 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 Sep 03 11:09:15 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:16 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12" returned: 0 in 0.382s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:16 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 is being set with open permissions: ugo+rw Sep 03 11:09:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:16 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 Sep 03 11:09:16 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:16 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12" returned: 0 in 0.264s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:16 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.info Sep 03 11:09:16 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:16 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.info" returned: 0 in 0.393s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:16 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.info is being set with open permissions: ugo+rw Sep 03 11:09:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:16 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.info Sep 03 11:09:16 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:17 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.info" returned: 0 in 0.305s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-9733eca5-66f2-4ace-93c9-cd4681a6df74 req-0b7a36ff-46b4-4260-8bc8-4670adceed75 tempest-TestMinimumBasicScenario-244082232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-9733eca5-66f2-4ace-93c9-cd4681a6df74 req-0b7a36ff-46b4-4260-8bc8-4670adceed75 tempest-TestMinimumBasicScenario-244082232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-753d1ad4-b2fc-434f-a380-4e2d4784247e tempest-SnapshotDependencyTests-28953100 None] Create snapshot completed successfully Sep 03 11:09:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-9733eca5-66f2-4ace-93c9-cd4681a6df74 req-0b7a36ff-46b4-4260-8bc8-4670adceed75 tempest-TestMinimumBasicScenario-244082232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-9733eca5-66f2-4ace-93c9-cd4681a6df74 req-0b7a36ff-46b4-4260-8bc8-4670adceed75 tempest-TestMinimumBasicScenario-244082232 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-05153ebd-d4ba-432d-8506-a87211081878', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ad15e1a-1ecc-44f3-a00a-1011653e2e33', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:09:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-9733eca5-66f2-4ace-93c9-cd4681a6df74 req-0b7a36ff-46b4-4260-8bc8-4670adceed75 tempest-TestMinimumBasicScenario-244082232 None] attachment_update completed successfully. Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Flow 'volume_create_manager' (272bc339-c816-43b1-898b-5ad9489ef494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b44711-e989-4b53-abeb-07e0d3e8ea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b44711-e989-4b53-abeb-07e0d3e8ea81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddafe2584c049c7be2242c1a50244d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a591d26-4cca-4d6b-8954-4422c61a2a12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:09:19Z,use_quota=True,user_id='c256bfcb9c494d13b8a85130483ebda2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fddfbb-af2f-4410-b2bd-b467480b5071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fddfbb-af2f-4410-b2bd-b467480b5071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ed23ef-ff8e-4d06-9c0f-a4e072faad0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ed23ef-ff8e-4d06-9c0f-a4e072faad0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b', 'volume_name': 'volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b', 'volume_size': 1, 'snapshot_id': '9a591d26-4cca-4d6b-8954-4422c61a2a12'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb8311c-a969-4cc2-8d4f-368d71899fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb8311c-a969-4cc2-8d4f-368d71899fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d51e6c3-880b-43dc-95f5-6e548fab2375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:18 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Volume f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b', 'volume_size': 1, 'snapshot_id': '9a591d26-4cca-4d6b-8954-4422c61a2a12'} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "cinder-quobyte-9a591d26-4cca-4d6b-8954-4422c61a2a12-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" by "_create_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-9a591d26-4cca-4d6b-8954-4422c61a2a12-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Creating volume f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b from snapshot 9a591d26-4cca-4d6b-8954-4422c61a2a12 {{(pid=86603) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "cinder-quobyte-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:09:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] snapshot: 9a591d26-4cca-4d6b-8954-4422c61a2a12, volume: f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ee0166-691b-4edb-b5cf-2d126cee4595]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:19 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 Sep 03 11:09:19 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:19 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12" returned: 0 in 0.446s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3613cf68-78d5-4033-a0fa-6adf5e961379]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:19 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d Sep 03 11:09:19 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:19 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" returned: 0 in 0.383s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:09:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:19 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b Sep 03 11:09:19 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:09:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:09:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:09:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:23 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:09:23 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:24 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.789s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:24 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:09:24 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:09:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:09:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:09:25 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" returned: 0 in 5.912s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:25 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:09:25 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Converted 1024.00 MB image at 173.19 MB/s Sep 03 11:09:25 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b is being set with open permissions: ugo+rw Sep 03 11:09:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:25 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b Sep 03 11:09:25 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:26 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" returned: 0 in 0.316s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" released by "_copy_volume_from_snapshot" :: held 7.183s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:09:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-9a591d26-4cca-4d6b-8954-4422c61a2a12-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" released by "_create_volume_from_snapshot" :: held 7.271s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:09:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.294s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d51e6c3-880b-43dc-95f5-6e548fab2375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b', 'volume_size': 1, 'snapshot_id': '9a591d26-4cca-4d6b-8954-4422c61a2a12'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3077c415-23d2-4f78-b6ce-24b2482b3bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:26 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Volume volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b (f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b): created successfully Sep 03 11:09:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3077c415-23d2-4f78-b6ce-24b2482b3bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Flow 'volume_create_manager' (272bc339-c816-43b1-898b-5ad9489ef494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:09:26 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-abdc051e-9dba-4ef1-b58d-8cfac80003d0 tempest-SnapshotDependencyTests-28953100 None] Created volume successfully. Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "cinder-9a591d26-4cca-4d6b-8954-4422c61a2a12-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-9a591d26-4cca-4d6b-8954-4422c61a2a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "cinder-quobyte-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "cinder-quobyte-9a591d26-4cca-4d6b-8954-4422c61a2a12" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-9a591d26-4cca-4d6b-8954-4422c61a2a12" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Deleting offline snapshot 9a591d26-4cca-4d6b-8954-4422c61a2a12 of volume 9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] snapshot_file for this snap is: volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc599b11-f438-4c3a-9a1a-53f04380cd3a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:27 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 Sep 03 11:09:27 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:27 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12" returned: 0 in 0.526s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[21657224-0e22-4388-b229-4f8929b4138b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:09:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:27 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d Sep 03 11:09:27 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:28 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" returned: 0 in 0.776s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:28 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 Sep 03 11:09:28 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:29 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12" returned: 0 in 0.480s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:29 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12 Sep 03 11:09:29 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:29 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d.9a591d26-4cca-4d6b-8954-4422c61a2a12" returned: 0 in 0.339s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-9a591d26-4cca-4d6b-8954-4422c61a2a12" released by "_delete_snapshot" :: held 2.330s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:09:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" released by "delete_snapshot" :: held 2.369s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:09:29 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Created reservations ['f9122d42-d3c3-4968-ba9b-847bf60c7756', '92f9b1d5-1eb6-41d6-bfa2-f6fe336c4f87', '96c42de5-545d-41e4-b719-c679de5dc3b7', '509171df-ba0c-4897-81d7-f64ab9a26427'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:09:29 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Delete snapshot completed successfully. Sep 03 11:09:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0468da97-2347-4b89-8f48-b247c9211962 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-9a591d26-4cca-4d6b-8954-4422c61a2a12-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:09:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "cinder-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:09:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:09:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "cinder-quobyte-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:09:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" acquired by "delete_volume" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:09:30 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a228c95d-9380-4efb-9315-9bcb755fcd73]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:09:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:30 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d Sep 03 11:09:30 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:31 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" returned: 0 in 0.556s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:31 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d Sep 03 11:09:31 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:31 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" returned: 0 in 0.381s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d" released by "delete_volume" :: held 1.021s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Created reservations ['4c7808a7-6c9d-47d0-a60e-f9815d10f468', '00ab8329-084f-4497-8bc9-7295134a1d67', '9c7e8a55-0b3f-4ac5-99fa-b5c7a4257bfc', '8dac4ace-5f52-4f60-9bb0-4fd63e907502'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:31 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:09:31 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:32 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.324s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:32 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:09:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Deleted volume successfully. Sep 03 11:09:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-fd36c01a-4c7a-42ad-bba9-f734fb0c0e0a tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-9c7e9aa6-8326-4d8d-9eb0-1c4186e5827d-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:09:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "cinder-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:09:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:09:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "cinder-quobyte-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:09:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:09:32 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12defc5-adc9-4efc-a31f-c25c7585a191]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:09:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:33 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b Sep 03 11:09:33 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:33 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" returned: 0 in 0.412s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:33 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b Sep 03 11:09:33 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:33 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" returned: 0 in 0.284s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-quobyte-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b" released by "delete_volume" :: held 0.743s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Created reservations ['5b401d94-8f43-40d2-b4c3-510bde895008', '5529836e-da25-4138-b302-400f0fc15f72', 'dd6a8bf5-b81d-4ed7-99fc-91fa2260511d', '2136c31a-899d-4aaf-82b0-79a1e0667ddd'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:33 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:09:33 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:34 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.298s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:34 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:09:34 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Deleted volume successfully. Sep 03 11:09:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e79ee325-e9b1-4074-a32b-be4bc4d900f0 tempest-SnapshotDependencyTests-28953100 None] Lock "cinder-f5e47eaf-3ecb-4afc-82fe-6da1d3a9128b-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:09:34 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:09:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Flow 'volume_create_manager' (6727d916-5028-4c76-9ffd-dd3f5c03e133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af52f2d2-c8ff-44b9-ac86-63df4113816f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af52f2d2-c8ff-44b9-ac86-63df4113816f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2120225446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4115783b-c110-482f-9372-d49daf3e6b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54eaa5066a04ccda43620642637845d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:09:35Z,use_quota=True,user_id='d31e2c3b66084659bae46067f4d294f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b44932-c7f3-4576-b722-3e67602e26a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b44932-c7f3-4576-b722-3e67602e26a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fc9116-18d0-4c0b-add0-c290fc75e489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fc9116-18d0-4c0b-add0-c290fc75e489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4115783b-c110-482f-9372-d49daf3e6b10', 'volume_name': 'volume-4115783b-c110-482f-9372-d49daf3e6b10', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c49420-2f1e-40c9-9217-bfab181f6d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c49420-2f1e-40c9-9217-bfab181f6d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779256d4-3dd0-4cb2-9ac7-8fd94b76672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:35 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Volume 4115783b-c110-482f-9372-d49daf3e6b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4115783b-c110-482f-9372-d49daf3e6b10', 'volume_size': 1} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2120225446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4115783b-c110-482f-9372-d49daf3e6b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54eaa5066a04ccda43620642637845d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:09:35Z,use_quota=True,user_id='d31e2c3b66084659bae46067f4d294f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Creating volume 4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:09:35 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:35 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 1073741824 Sep 03 11:09:35 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:35 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 1073741824" returned: 0 in 0.534s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:35 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 Sep 03 11:09:35 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:36 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10" returned: 0 in 0.382s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:09:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:09:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779256d4-3dd0-4cb2-9ac7-8fd94b76672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4115783b-c110-482f-9372-d49daf3e6b10', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9f1a7b-5ffc-440b-bc36-663771a8f0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:09:36 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Volume volume-4115783b-c110-482f-9372-d49daf3e6b10 (4115783b-c110-482f-9372-d49daf3e6b10): created successfully Sep 03 11:09:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9f1a7b-5ffc-440b-bc36-663771a8f0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:09:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Flow 'volume_create_manager' (6727d916-5028-4c76-9ffd-dd3f5c03e133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:09:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0fea33a2-9f27-400d-b0eb-39896d002bdb tempest-TestStampPattern-1561908021 None] Created volume successfully. Sep 03 11:09:46 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=32,cinder:SELECT=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:09:46 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=41,cinder:UPDATE=42,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:10:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e146acb5-9065-4b02-a5e4-b46ce2ea8ce6 req-9a1e2fb1-078d-48f8-9ac6-dfdc0b60eefe tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e146acb5-9065-4b02-a5e4-b46ce2ea8ce6 req-9a1e2fb1-078d-48f8-9ac6-dfdc0b60eefe tempest-TestStampPattern-1561908021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-e146acb5-9065-4b02-a5e4-b46ce2ea8ce6 req-9a1e2fb1-078d-48f8-9ac6-dfdc0b60eefe tempest-TestStampPattern-1561908021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-e146acb5-9065-4b02-a5e4-b46ce2ea8ce6 req-9a1e2fb1-078d-48f8-9ac6-dfdc0b60eefe tempest-TestStampPattern-1561908021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-4115783b-c110-482f-9372-d49daf3e6b10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22b5d1ec-1045-48b3-93ec-ab5abbc304c6', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:10:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-e146acb5-9065-4b02-a5e4-b46ce2ea8ce6 req-9a1e2fb1-078d-48f8-9ac6-dfdc0b60eefe tempest-TestStampPattern-1561908021 None] attachment_update completed successfully. Sep 03 11:10:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-3fea7a93-7e87-4255-a29c-4e091778f69d req-81666ad7-ce38-4f76-ba62-65b112847ec6 tempest-TestMinimumBasicScenario-244082232 None] Terminate volume connection completed successfully. Sep 03 11:10:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-3fea7a93-7e87-4255-a29c-4e091778f69d req-81666ad7-ce38-4f76-ba62-65b112847ec6 tempest-TestMinimumBasicScenario-244082232 None] Deleting attachment 2ad15e1a-1ecc-44f3-a00a-1011653e2e33. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:10:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Acquiring lock "cinder-05153ebd-d4ba-432d-8506-a87211081878-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:10:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Lock "cinder-05153ebd-d4ba-432d-8506-a87211081878-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:10:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Acquiring lock "cinder-quobyte-05153ebd-d4ba-432d-8506-a87211081878" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:10:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Lock "cinder-quobyte-05153ebd-d4ba-432d-8506-a87211081878" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:10:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af30099-2dd8-4be7-a5c6-c51daa71fc5c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:10:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:10 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878 Sep 03 11:10:10 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:11 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878" returned: 0 in 0.392s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:11 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878 Sep 03 11:10:11 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:11 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-05153ebd-d4ba-432d-8506-a87211081878" returned: 0 in 0.263s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Lock "cinder-quobyte-05153ebd-d4ba-432d-8506-a87211081878" released by "delete_volume" :: held 0.695s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Created reservations ['7d930153-92b6-439a-be64-9aaf1158c5fe', 'db5daeb7-c11a-4073-a216-397f02781280', 'aef3c446-23c3-4f7a-a52e-2c5fcd57dd26', 'be9462f0-8558-4237-be4c-b718bc66da75'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:11 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:10:11 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:11 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.260s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:10:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Deleted volume successfully. Sep 03 11:10:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3d6246db-acc7-4a3f-b02d-610c2423e680 tempest-TestMinimumBasicScenario-244082232 None] Lock "cinder-05153ebd-d4ba-432d-8506-a87211081878-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:10:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-f93bcd65-7293-48e8-b3c3-4ff09064d928 req-b8a53211-e5b0-4393-b175-70cd4f6ef7d8 tempest-TestStampPattern-1561908021 None] Terminate volume connection completed successfully. Sep 03 11:10:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-f93bcd65-7293-48e8-b3c3-4ff09064d928 req-b8a53211-e5b0-4393-b175-70cd4f6ef7d8 tempest-TestStampPattern-1561908021 None] Deleting attachment 22b5d1ec-1045-48b3-93ec-ab5abbc304c6. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:10:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:14 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Creating offline snapshot 7d78b6ba-6cb8-4015-9ffa-512aee2205a8 of volume 4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:10:14 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d22781-42f2-4ff8-931d-e9d0e05bcf84]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:10:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:14 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 Sep 03 11:10:14 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:14 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10" returned: 0 in 0.382s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:14 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 1G Sep 03 11:10:14 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:15 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 1G" returned: 0 in 0.466s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4115783b-c110-482f-9372-d49daf3e6b10 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:15 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4115783b-c110-482f-9372-d49daf3e6b10 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 Sep 03 11:10:15 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:15 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4115783b-c110-482f-9372-d49daf3e6b10 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8" returned: 0 in 0.308s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:15 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 is being set with open permissions: ugo+rw Sep 03 11:10:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:15 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 Sep 03 11:10:15 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:15 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:15 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.info Sep 03 11:10:15 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:16 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.info" returned: 0 in 0.279s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:16 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.info is being set with open permissions: ugo+rw Sep 03 11:10:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:16 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.info Sep 03 11:10:16 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:16 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.info" returned: 0 in 0.252s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8a4f1f5f-dfaf-4ad2-bc92-c2b72b0fcdf1 tempest-TestStampPattern-1561908021 None] Create snapshot completed successfully Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:23 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:10:23 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:23 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.333s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:10:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Flow 'volume_create_manager' (8c191230-796c-4728-9914-8d962cd49109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dcc993-edea-4332-b551-0d8667101044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dcc993-edea-4332-b551-0d8667101044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-305439260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2a42b3-1423-4781-9a59-8818633b809a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54eaa5066a04ccda43620642637845d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d78b6ba-6cb8-4015-9ffa-512aee2205a8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:10:24Z,use_quota=True,user_id='d31e2c3b66084659bae46067f4d294f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ff0142-bf3f-4e88-9a94-f0aa3a1b2946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ff0142-bf3f-4e88-9a94-f0aa3a1b2946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8483524f-22bf-4e27-893b-ff35c155c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8483524f-22bf-4e27-893b-ff35c155c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb2a42b3-1423-4781-9a59-8818633b809a', 'volume_name': 'volume-cb2a42b3-1423-4781-9a59-8818633b809a', 'volume_size': 1, 'snapshot_id': '7d78b6ba-6cb8-4015-9ffa-512aee2205a8'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d6d484-c019-4f30-a748-e95e46212f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d6d484-c019-4f30-a748-e95e46212f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08025dc-1c60-4060-9ba8-b764cf2efea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:24 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Volume cb2a42b3-1423-4781-9a59-8818633b809a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb2a42b3-1423-4781-9a59-8818633b809a', 'volume_size': 1, 'snapshot_id': '7d78b6ba-6cb8-4015-9ffa-512aee2205a8'} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Acquiring lock "cinder-quobyte-7d78b6ba-6cb8-4015-9ffa-512aee2205a8-cb2a42b3-1423-4781-9a59-8818633b809a" by "_create_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-7d78b6ba-6cb8-4015-9ffa-512aee2205a8-cb2a42b3-1423-4781-9a59-8818633b809a" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Creating volume cb2a42b3-1423-4781-9a59-8818633b809a from snapshot 7d78b6ba-6cb8-4015-9ffa-512aee2205a8 {{(pid=86603) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Acquiring lock "cinder-quobyte-cb2a42b3-1423-4781-9a59-8818633b809a" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-cb2a42b3-1423-4781-9a59-8818633b809a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] snapshot: 7d78b6ba-6cb8-4015-9ffa-512aee2205a8, volume: cb2a42b3-1423-4781-9a59-8818633b809a, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae77dfb-ec3d-45f1-a469-f1c11d73021a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:10:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:24 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 Sep 03 11:10:24 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:25 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8" returned: 0 in 0.440s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4115783b-c110-482f-9372-d49daf3e6b10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:10:25 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe4d266-40bc-4e94-b577-1adabdec9cf8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:10:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:25 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 Sep 03 11:10:25 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:25 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10" returned: 0 in 0.411s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:10:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:10:25 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:10:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:25 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a Sep 03 11:10:25 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:31 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a" returned: 0 in 6.475s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:31 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:10:31 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Converted 1024.00 MB image at 158.07 MB/s Sep 03 11:10:31 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a is being set with open permissions: ugo+rw Sep 03 11:10:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:32 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a Sep 03 11:10:32 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:32 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a" returned: 0 in 0.329s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-cb2a42b3-1423-4781-9a59-8818633b809a" released by "_copy_volume_from_snapshot" :: held 7.775s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:10:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-7d78b6ba-6cb8-4015-9ffa-512aee2205a8-cb2a42b3-1423-4781-9a59-8818633b809a" released by "_create_volume_from_snapshot" :: held 7.876s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:10:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.899s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08025dc-1c60-4060-9ba8-b764cf2efea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2a42b3-1423-4781-9a59-8818633b809a', 'volume_size': 1, 'snapshot_id': '7d78b6ba-6cb8-4015-9ffa-512aee2205a8'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2695f72-48a6-4aed-ae39-58fb174c928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:32 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Volume volume-cb2a42b3-1423-4781-9a59-8818633b809a (cb2a42b3-1423-4781-9a59-8818633b809a): created successfully Sep 03 11:10:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2695f72-48a6-4aed-ae39-58fb174c928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Flow 'volume_create_manager' (8c191230-796c-4728-9914-8d962cd49109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:10:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3ebddb9a-960b-4809-9185-af92b2afc6f7 tempest-TestStampPattern-1561908021 None] Created volume successfully. Sep 03 11:10:42 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=21,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:10:42 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=20,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Flow 'volume_create_manager' (e75df4e0-6246-4846-a864-069375875317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4864ed-343d-425f-a477-d424ae6df578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4864ed-343d-425f-a477-d424ae6df578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1027501311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5def7ce-b939-424d-b1ca-d1bc300cec73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0673c5f81d3244558cb72e88b95de4e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:10:55Z,use_quota=True,user_id='95244212b260454393291c876b0819ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1e9858-e687-4d99-8a34-0937140a91c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1e9858-e687-4d99-8a34-0937140a91c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d82b0d-7e3c-4476-a83d-8b3d1ec3453c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d82b0d-7e3c-4476-a83d-8b3d1ec3453c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5def7ce-b939-424d-b1ca-d1bc300cec73', 'volume_name': 'volume-b5def7ce-b939-424d-b1ca-d1bc300cec73', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbff6b6-75d7-4224-a643-6c78d697ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbff6b6-75d7-4224-a643-6c78d697ae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fd864b-c750-4ddc-9ca6-df9d10b967d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:54 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Volume b5def7ce-b939-424d-b1ca-d1bc300cec73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5def7ce-b939-424d-b1ca-d1bc300cec73', 'volume_size': 1} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1027501311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5def7ce-b939-424d-b1ca-d1bc300cec73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0673c5f81d3244558cb72e88b95de4e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:10:55Z,use_quota=True,user_id='95244212b260454393291c876b0819ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Creating volume b5def7ce-b939-424d-b1ca-d1bc300cec73 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:10:54 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:10:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:54 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 1073741824 Sep 03 11:10:54 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Flow 'volume_create_manager' (e964290b-0c9e-4184-bdfd-068bd106a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd78cfdc-7bd3-4d65-9a7f-ca597423664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd78cfdc-7bd3-4d65-9a7f-ca597423664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1514073821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0673c5f81d3244558cb72e88b95de4e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:10:55Z,use_quota=True,user_id='95244212b260454393291c876b0819ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7227b8-13c4-48fd-8e15-1f828eb2414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7227b8-13c4-48fd-8e15-1f828eb2414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab7e534-0f3b-46a6-a67a-1020fc14c677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab7e534-0f3b-46a6-a67a-1020fc14c677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b', 'volume_name': 'volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcd9719-5168-4c2c-baf2-0b8411d2ab04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcd9719-5168-4c2c-baf2-0b8411d2ab04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353d9fad-ae31-415c-aa85-06f255e25df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Volume c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b', 'volume_size': 1} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:55 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 1073741824" returned: 0 in 0.508s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:55 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 Sep 03 11:10:55 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:55 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73" returned: 0 in 0.268s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1514073821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0673c5f81d3244558cb72e88b95de4e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:10:55Z,use_quota=True,user_id='95244212b260454393291c876b0819ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Creating volume c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:10:55 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:55 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b 1073741824 Sep 03 11:10:55 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fd864b-c750-4ddc-9ca6-df9d10b967d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5def7ce-b939-424d-b1ca-d1bc300cec73', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0fd69e-f137-4c86-b0c3-9e0b9daf4880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Volume volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 (b5def7ce-b939-424d-b1ca-d1bc300cec73): created successfully Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0fd69e-f137-4c86-b0c3-9e0b9daf4880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Flow 'volume_create_manager' (e75df4e0-6246-4846-a864-069375875317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:10:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a2108d0a-79c1-45fe-8aca-6d65057f9554 tempest-TestServerVolumeAttachmentScenario-874451905 None] Created volume successfully. Sep 03 11:10:56 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b 1073741824" returned: 0 in 0.460s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:56 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b Sep 03 11:10:56 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:56 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b" returned: 0 in 0.275s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:10:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:10:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353d9fad-ae31-415c-aa85-06f255e25df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ce236f-a346-4af1-b519-7a30d361b019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:10:56 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Volume volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b (c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b): created successfully Sep 03 11:10:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ce236f-a346-4af1-b519-7a30d361b019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:10:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Flow 'volume_create_manager' (e964290b-0c9e-4184-bdfd-068bd106a120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:10:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-54fa7cc2-1391-48d3-8a15-ce29a433de79 tempest-TestServerVolumeAttachmentScenario-874451905 None] Created volume successfully. Sep 03 11:11:06 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=6,cinder:SELECT=3 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:11:06 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:11:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-f6c1e3d0-f285-4dc3-a9e5-23b67634eef4 req-91bdb26b-5c5a-4b23-b7c7-0dcb7fb2b5a0 tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-f6c1e3d0-f285-4dc3-a9e5-23b67634eef4 req-91bdb26b-5c5a-4b23-b7c7-0dcb7fb2b5a0 tempest-TestStampPattern-1561908021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-f6c1e3d0-f285-4dc3-a9e5-23b67634eef4 req-91bdb26b-5c5a-4b23-b7c7-0dcb7fb2b5a0 tempest-TestStampPattern-1561908021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-f6c1e3d0-f285-4dc3-a9e5-23b67634eef4 req-91bdb26b-5c5a-4b23-b7c7-0dcb7fb2b5a0 tempest-TestStampPattern-1561908021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-cb2a42b3-1423-4781-9a59-8818633b809a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ebd20f8-fceb-4346-80ea-4af8f415cd12', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:11:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-f6c1e3d0-f285-4dc3-a9e5-23b67634eef4 req-91bdb26b-5c5a-4b23-b7c7-0dcb7fb2b5a0 tempest-TestStampPattern-1561908021 None] attachment_update completed successfully. Sep 03 11:11:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-ed937777-bbd8-4f47-9c9c-a8899d6c6275 req-f8b306e1-0ade-4fa2-9e9e-6c6c13f9b448 tempest-TestStampPattern-1561908021 None] Terminate volume connection completed successfully. Sep 03 11:11:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-ed937777-bbd8-4f47-9c9c-a8899d6c6275 req-f8b306e1-0ade-4fa2-9e9e-6c6c13f9b448 tempest-TestStampPattern-1561908021 None] Deleting attachment 7ebd20f8-fceb-4346-80ea-4af8f415cd12. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:11:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Acquiring lock "cinder-cb2a42b3-1423-4781-9a59-8818633b809a-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Lock "cinder-cb2a42b3-1423-4781-9a59-8818633b809a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Acquiring lock "cinder-quobyte-cb2a42b3-1423-4781-9a59-8818633b809a" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-cb2a42b3-1423-4781-9a59-8818633b809a" acquired by "delete_volume" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:22 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0335f42f-82d3-49e7-b867-8db80c15faac]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:22 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a Sep 03 11:11:22 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:23 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a" returned: 0 in 0.376s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:23 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a Sep 03 11:11:23 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:23 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cb2a42b3-1423-4781-9a59-8818633b809a" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-cb2a42b3-1423-4781-9a59-8818633b809a" released by "delete_volume" :: held 0.669s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Created reservations ['32874acf-e653-478c-a8ce-93e96618e7c4', '96e1645a-5d78-48c2-99a4-fc75ddf6a5d8', '034bfad0-11e4-48be-8596-e2484b67f6a3', 'e5ab31f4-5e19-4948-8f96-544d0df3716a'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:23 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:11:23 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:23 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:11:23 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:23 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.273s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:11:23 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.275s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:11:23 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Deleted volume successfully. Sep 03 11:11:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eff7d372-0151-4203-810a-32b81d84448e tempest-TestStampPattern-1561908021 None] Lock "cinder-cb2a42b3-1423-4781-9a59-8818633b809a-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Acquiring lock "cinder-7d78b6ba-6cb8-4015-9ffa-512aee2205a8-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Lock "cinder-7d78b6ba-6cb8-4015-9ffa-512aee2205a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Acquiring lock "cinder-quobyte-4115783b-c110-482f-9372-d49daf3e6b10" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-4115783b-c110-482f-9372-d49daf3e6b10" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Acquiring lock "cinder-quobyte-7d78b6ba-6cb8-4015-9ffa-512aee2205a8" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-7d78b6ba-6cb8-4015-9ffa-512aee2205a8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Deleting offline snapshot 7d78b6ba-6cb8-4015-9ffa-512aee2205a8 of volume 4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] snapshot_file for this snap is: volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1431240-d925-444d-ae25-620afdb41203]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:24 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 Sep 03 11:11:24 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:24 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8" returned: 0 in 0.406s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4115783b-c110-482f-9372-d49daf3e6b10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b197e4-4550-4039-a224-0861f8b00330]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:24 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 Sep 03 11:11:24 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:25 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10" returned: 0 in 0.574s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:25 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 Sep 03 11:11:25 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:25 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8" returned: 0 in 0.371s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:25 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8 Sep 03 11:11:25 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:25 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10.7d78b6ba-6cb8-4015-9ffa-512aee2205a8" returned: 0 in 0.292s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-7d78b6ba-6cb8-4015-9ffa-512aee2205a8" released by "_delete_snapshot" :: held 1.751s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-4115783b-c110-482f-9372-d49daf3e6b10" released by "delete_snapshot" :: held 1.774s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:26 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Created reservations ['91221b1c-df55-4b3b-afcb-39a031913b4d', '4b723a11-40f2-4cf4-ba6f-7399cf60b0c8', '7442c076-8e5f-460a-9978-1b8a1a30a4e8', 'c67d3d8c-19a5-4e37-a682-85ed18266b78'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:11:26 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Delete snapshot completed successfully. Sep 03 11:11:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-54c7f56a-36c6-4f2d-8c8c-1bf68d1bec1c tempest-TestStampPattern-1561908021 None] Lock "cinder-7d78b6ba-6cb8-4015-9ffa-512aee2205a8-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-41861df7-8da7-43aa-b6f5-afac5e8c7c6b req-8a57926a-fd79-435c-a155-6e2aea130a10 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-41861df7-8da7-43aa-b6f5-afac5e8c7c6b req-8a57926a-fd79-435c-a155-6e2aea130a10 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-41861df7-8da7-43aa-b6f5-afac5e8c7c6b req-8a57926a-fd79-435c-a155-6e2aea130a10 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-41861df7-8da7-43aa-b6f5-afac5e8c7c6b req-8a57926a-fd79-435c-a155-6e2aea130a10 tempest-TestServerVolumeAttachmentScenario-874451905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-b5def7ce-b939-424d-b1ca-d1bc300cec73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '171e4d5e-15fb-477a-be87-7eb3439a1f70', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:11:26 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-41861df7-8da7-43aa-b6f5-afac5e8c7c6b req-8a57926a-fd79-435c-a155-6e2aea130a10 tempest-TestServerVolumeAttachmentScenario-874451905 None] attachment_update completed successfully. Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Acquiring lock "cinder-4115783b-c110-482f-9372-d49daf3e6b10-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Lock "cinder-4115783b-c110-482f-9372-d49daf3e6b10-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Acquiring lock "cinder-quobyte-4115783b-c110-482f-9372-d49daf3e6b10" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-4115783b-c110-482f-9372-d49daf3e6b10" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef53ef99-c7b3-456b-8d20-5e70a4d4cd63]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:30 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 Sep 03 11:11:30 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:30 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10" returned: 0 in 0.378s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:30 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10 Sep 03 11:11:30 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:30 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4115783b-c110-482f-9372-d49daf3e6b10" returned: 0 in 0.273s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Lock "cinder-quobyte-4115783b-c110-482f-9372-d49daf3e6b10" released by "delete_volume" :: held 0.708s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Created reservations ['21c4b78c-c7e9-45c0-9202-95f157a5a850', '32ba186f-3b4c-44f4-98c5-a69664d94575', '2ca43b03-e16d-4105-b376-46d5e08d98ac', '090bff8d-5d71-4024-9d2c-4caf6d838fce'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:30 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:11:30 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-8dddb3ac-8212-4d71-982f-2fe453caa787 req-63816b84-496f-4ff9-a1dc-b2cccdbc3df6 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-8dddb3ac-8212-4d71-982f-2fe453caa787 req-63816b84-496f-4ff9-a1dc-b2cccdbc3df6 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [req-8dddb3ac-8212-4d71-982f-2fe453caa787 req-63816b84-496f-4ff9-a1dc-b2cccdbc3df6 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:31 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-8dddb3ac-8212-4d71-982f-2fe453caa787 req-63816b84-496f-4ff9-a1dc-b2cccdbc3df6 tempest-TestServerVolumeAttachmentScenario-874451905 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6', 'name': 'volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8b6520b-c1fb-48dc-8899-b36c2e3c02c2', 'enforce_multipath': True} {{(pid=86603) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:11:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-8dddb3ac-8212-4d71-982f-2fe453caa787 req-63816b84-496f-4ff9-a1dc-b2cccdbc3df6 tempest-TestServerVolumeAttachmentScenario-874451905 None] attachment_update completed successfully. Sep 03 11:11:31 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.276s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:31 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:11:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Deleted volume successfully. Sep 03 11:11:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-98e9bf5a-77fb-4e0d-a30f-f176e22524cc tempest-TestStampPattern-1561908021 None] Lock "cinder-4115783b-c110-482f-9372-d49daf3e6b10-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-fda905a8-bb4f-45b4-a501-00fa7310ecbb req-ed485ee1-b30c-4d51-a089-01fb9e6ec474 tempest-TestServerVolumeAttachmentScenario-874451905 None] Terminate volume connection completed successfully. Sep 03 11:11:32 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-fda905a8-bb4f-45b4-a501-00fa7310ecbb req-ed485ee1-b30c-4d51-a089-01fb9e6ec474 tempest-TestServerVolumeAttachmentScenario-874451905 None] Deleting attachment f8b6520b-c1fb-48dc-8899-b36c2e3c02c2. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:11:34 devstack cinder-volume[86603]: INFO cinder.volume.manager [req-744a2d09-764b-4e13-89ff-94c3d2a53541 req-e3151fd1-c8cc-4042-a901-c2008a59f893 tempest-TestServerVolumeAttachmentScenario-874451905 None] Terminate volume connection completed successfully. Sep 03 11:11:34 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [req-744a2d09-764b-4e13-89ff-94c3d2a53541 req-e3151fd1-c8cc-4042-a901-c2008a59f893 tempest-TestServerVolumeAttachmentScenario-874451905 None] Deleting attachment 171e4d5e-15fb-477a-be87-7eb3439a1f70. {{(pid=86603) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:11:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "cinder-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "cinder-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "cinder-quobyte-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "cinder-quobyte-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:39 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a927e79-1bac-4826-9eda-a7d0c04ee422]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:39 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b Sep 03 11:11:39 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:40 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b" returned: 0 in 0.462s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:40 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b Sep 03 11:11:40 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:40 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b" returned: 0 in 0.273s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "cinder-quobyte-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b" released by "delete_volume" :: held 0.777s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Created reservations ['9af2f9a9-b1ac-435b-8866-19a040d7f4d3', '19a5d7f8-39e4-42f2-a915-8f85da233b85', '2fff0b93-fdea-4d13-ad08-f8a853532f66', '127e6111-c43a-43c4-92df-c3096d1e658d'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:40 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:11:40 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "cinder-b5def7ce-b939-424d-b1ca-d1bc300cec73-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:40 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "cinder-b5def7ce-b939-424d-b1ca-d1bc300cec73-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:40 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Deleted volume successfully. Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-58060373-3627-4f26-b041-b2bb228eb182 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "cinder-c8a8668c-1f1a-43b8-880b-6f5eeacf0c0b-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "cinder-quobyte-b5def7ce-b939-424d-b1ca-d1bc300cec73" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "cinder-quobyte-b5def7ce-b939-424d-b1ca-d1bc300cec73" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae1292d-717a-4feb-b069-95a8f78c33c3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:41 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 Sep 03 11:11:41 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:41 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73" returned: 0 in 0.418s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:41 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73 Sep 03 11:11:41 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:41 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b5def7ce-b939-424d-b1ca-d1bc300cec73" returned: 0 in 0.260s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "cinder-quobyte-b5def7ce-b939-424d-b1ca-d1bc300cec73" released by "delete_volume" :: held 0.730s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Created reservations ['ac95e9b1-7730-40c9-a858-676347616a90', '90d05e99-9663-464e-b8c8-c161498edfd0', '1ff78b8a-c57a-4a8a-a0df-6665b5a58a2a', 'd4fc381d-e9c9-4eaf-a9ef-5f663604d161'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:41 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:11:41 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:41 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.288s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:41 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:11:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Deleted volume successfully. Sep 03 11:11:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f9d89485-b620-4e6d-8ad9-edb48bc6be35 tempest-TestServerVolumeAttachmentScenario-874451905 None] Lock "cinder-b5def7ce-b939-424d-b1ca-d1bc300cec73-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Flow 'volume_create_manager' (d56b1338-f2df-4dfb-8e45-e6e046c25b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951b6b2b-84aa-463b-ba6d-03dd66df7380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951b6b2b-84aa-463b-ba6d-03dd66df7380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-323247186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca45777-d84e-4070-a212-c9242bc49b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7fd8491b0d46f6828f747bb4ce7ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:11:44Z,use_quota=True,user_id='8b6b647adc8e4efb8213af129ab27724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcad54ee-540b-4803-b286-23ab44b9c7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcad54ee-540b-4803-b286-23ab44b9c7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe14997-3256-483d-a137-117515543cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe14997-3256-483d-a137-117515543cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dca45777-d84e-4070-a212-c9242bc49b95', 'volume_name': 'volume-dca45777-d84e-4070-a212-c9242bc49b95', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ec161f-47c6-4e2b-b8ac-bab1ec2865fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ec161f-47c6-4e2b-b8ac-bab1ec2865fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9975e0f3-2e84-43a5-aa96-f6d37165f39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Volume dca45777-d84e-4070-a212-c9242bc49b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dca45777-d84e-4070-a212-c9242bc49b95', 'volume_size': 1} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-323247186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca45777-d84e-4070-a212-c9242bc49b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7fd8491b0d46f6828f747bb4ce7ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:11:44Z,use_quota=True,user_id='8b6b647adc8e4efb8213af129ab27724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Creating volume dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:11:44 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:11:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:44 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 1073741824 Sep 03 11:11:44 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:45 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 1073741824" returned: 0 in 0.469s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:45 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 Sep 03 11:11:45 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:45 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95" returned: 0 in 0.262s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9975e0f3-2e84-43a5-aa96-f6d37165f39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca45777-d84e-4070-a212-c9242bc49b95', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb76746-8ee0-4443-8e17-a0c79943b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:45 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Volume volume-dca45777-d84e-4070-a212-c9242bc49b95 (dca45777-d84e-4070-a212-c9242bc49b95): created successfully Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb76746-8ee0-4443-8e17-a0c79943b185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Flow 'volume_create_manager' (d56b1338-f2df-4dfb-8e45-e6e046c25b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:11:45 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f84c3e51-7022-456c-893f-882848b587ff tempest-VolumeDependencyTests-1165443440 None] Created volume successfully. Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Creating offline snapshot c29c94ab-f717-4df4-8631-7a1942a2ce45 of volume dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[be03d2f1-9a06-491e-bfef-c44c3f864b05]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:45 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 Sep 03 11:11:45 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:46 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95" returned: 0 in 0.383s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:46 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 1G Sep 03 11:11:46 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:46 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 1G" returned: 0 in 0.524s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dca45777-d84e-4070-a212-c9242bc49b95 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:46 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dca45777-d84e-4070-a212-c9242bc49b95 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 Sep 03 11:11:46 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:46 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dca45777-d84e-4070-a212-c9242bc49b95 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45" returned: 0 in 0.341s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:46 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 is being set with open permissions: ugo+rw Sep 03 11:11:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:46 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 Sep 03 11:11:47 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:47 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45" returned: 0 in 0.279s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:47 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.info Sep 03 11:11:47 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:47 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.info" returned: 0 in 0.283s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:47 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.info is being set with open permissions: ugo+rw Sep 03 11:11:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:47 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.info Sep 03 11:11:47 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:47 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.info" returned: 0 in 0.244s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8ed22ede-276b-421b-9cfd-503525548443 tempest-VolumeDependencyTests-1165443440 None] Create snapshot completed successfully Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Flow 'volume_create_manager' (aeb07be9-dbb0-4d06-b033-66767a66529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01875ee5-b88e-45d5-8b3c-478d5dc55a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01875ee5-b88e-45d5-8b3c-478d5dc55a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1989573285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3976f6f8-8cc0-4228-a49a-6118a344cdb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7fd8491b0d46f6828f747bb4ce7ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c29c94ab-f717-4df4-8631-7a1942a2ce45,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:11:49Z,use_quota=True,user_id='8b6b647adc8e4efb8213af129ab27724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84a10f1-0f53-486e-bdf9-85b572fb07ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84a10f1-0f53-486e-bdf9-85b572fb07ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63961fb5-796e-475a-9911-bf942750b2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63961fb5-796e-475a-9911-bf942750b2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3976f6f8-8cc0-4228-a49a-6118a344cdb8', 'volume_name': 'volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8', 'volume_size': 1, 'snapshot_id': 'c29c94ab-f717-4df4-8631-7a1942a2ce45'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9addf9c-9527-4f88-8ef5-26e2b4e39c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9addf9c-9527-4f88-8ef5-26e2b4e39c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07884634-4cb8-437d-9ba6-0a247b3f3a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:49 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Volume 3976f6f8-8cc0-4228-a49a-6118a344cdb8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8', 'volume_size': 1, 'snapshot_id': 'c29c94ab-f717-4df4-8631-7a1942a2ce45'} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "cinder-quobyte-c29c94ab-f717-4df4-8631-7a1942a2ce45-3976f6f8-8cc0-4228-a49a-6118a344cdb8" by "_create_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-c29c94ab-f717-4df4-8631-7a1942a2ce45-3976f6f8-8cc0-4228-a49a-6118a344cdb8" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Creating volume 3976f6f8-8cc0-4228-a49a-6118a344cdb8 from snapshot c29c94ab-f717-4df4-8631-7a1942a2ce45 {{(pid=86603) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "cinder-quobyte-3976f6f8-8cc0-4228-a49a-6118a344cdb8" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-3976f6f8-8cc0-4228-a49a-6118a344cdb8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] snapshot: c29c94ab-f717-4df4-8631-7a1942a2ce45, volume: 3976f6f8-8cc0-4228-a49a-6118a344cdb8, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ae0884-28dc-48f3-ab33-a1277feaacac]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:49 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 Sep 03 11:11:49 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:50 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45" returned: 0 in 0.368s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dca45777-d84e-4070-a212-c9242bc49b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:11:50 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3a22c6-9bc6-4943-b406-db47d268427d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:50 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 Sep 03 11:11:50 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:50 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95" returned: 0 in 0.353s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:11:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:11:50 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:11:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:50 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 Sep 03 11:11:50 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:55 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8" returned: 0 in 5.142s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:11:55 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Converted 1024.00 MB image at 199.10 MB/s Sep 03 11:11:55 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 is being set with open permissions: ugo+rw Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:55 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 Sep 03 11:11:55 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:55 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8" returned: 0 in 0.248s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-3976f6f8-8cc0-4228-a49a-6118a344cdb8" released by "_copy_volume_from_snapshot" :: held 6.202s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-c29c94ab-f717-4df4-8631-7a1942a2ce45-3976f6f8-8cc0-4228-a49a-6118a344cdb8" released by "_create_volume_from_snapshot" :: held 6.275s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.295s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07884634-4cb8-437d-9ba6-0a247b3f3a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8', 'volume_size': 1, 'snapshot_id': 'c29c94ab-f717-4df4-8631-7a1942a2ce45'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733d32b1-ec64-43c2-8884-3d1ef7e24917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:11:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Volume volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 (3976f6f8-8cc0-4228-a49a-6118a344cdb8): created successfully Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733d32b1-ec64-43c2-8884-3d1ef7e24917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:11:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Flow 'volume_create_manager' (aeb07be9-dbb0-4d06-b033-66767a66529f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:11:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0eeb80b6-6c29-4b9b-8ae2-41d448b46564 tempest-VolumeDependencyTests-1165443440 None] Created volume successfully. Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "cinder-c29c94ab-f717-4df4-8631-7a1942a2ce45-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-c29c94ab-f717-4df4-8631-7a1942a2ce45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "cinder-quobyte-dca45777-d84e-4070-a212-c9242bc49b95" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-dca45777-d84e-4070-a212-c9242bc49b95" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "cinder-quobyte-c29c94ab-f717-4df4-8631-7a1942a2ce45" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-c29c94ab-f717-4df4-8631-7a1942a2ce45" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Deleting offline snapshot c29c94ab-f717-4df4-8631-7a1942a2ce45 of volume dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] snapshot_file for this snap is: volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb488e21-7dbe-4330-95cc-4d2e653dbd8b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:56 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 Sep 03 11:11:56 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:56 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45" returned: 0 in 0.401s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dca45777-d84e-4070-a212-c9242bc49b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95c2458-7b90-413d-ae66-409beada3369]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:56 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 Sep 03 11:11:56 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:57 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95" returned: 0 in 0.587s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:57 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 Sep 03 11:11:57 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:57 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45" returned: 0 in 0.362s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:57 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45 Sep 03 11:11:57 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:57 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95.c29c94ab-f717-4df4-8631-7a1942a2ce45" returned: 0 in 0.264s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-c29c94ab-f717-4df4-8631-7a1942a2ce45" released by "_delete_snapshot" :: held 1.725s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-dca45777-d84e-4070-a212-c9242bc49b95" released by "delete_snapshot" :: held 1.751s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:57 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Created reservations ['d37dacef-c8e7-4f1d-b8eb-51b0232ce77a', 'aba38624-8871-40c0-bc30-01ff8a5af396', '13c64aa5-42f9-4564-a98e-be15b8a271d0', '03c66da2-78aa-4664-9215-a7874db776d6'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:11:58 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Delete snapshot completed successfully. Sep 03 11:11:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-19717f9c-cde0-4efb-a7a6-0a94ded558f6 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-c29c94ab-f717-4df4-8631-7a1942a2ce45-delete_snapshot" released by "delete_snapshot" :: held 1.894s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "cinder-dca45777-d84e-4070-a212-c9242bc49b95-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-dca45777-d84e-4070-a212-c9242bc49b95-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "cinder-quobyte-dca45777-d84e-4070-a212-c9242bc49b95" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-dca45777-d84e-4070-a212-c9242bc49b95" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:58 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[85884b86-e3b5-4cd3-b704-e8dd0a9e7c0b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:58 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 Sep 03 11:11:58 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:58 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95" returned: 0 in 0.386s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:58 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95 Sep 03 11:11:58 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:59 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-dca45777-d84e-4070-a212-c9242bc49b95" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-dca45777-d84e-4070-a212-c9242bc49b95" released by "delete_volume" :: held 0.718s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Created reservations ['400884bb-ff2c-44bb-a57f-6592ed7b1803', '1210d53a-edbf-4480-a729-2d3c9376ff6b', '4ebdcd79-19e2-4973-8ac4-31971dcaa859', '39f10e77-569b-4e78-9ef4-37ffe7030600'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:59 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:11:59 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "cinder-3976f6f8-8cc0-4228-a49a-6118a344cdb8-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:59 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.274s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-3976f6f8-8cc0-4228-a49a-6118a344cdb8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Deleted volume successfully. Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0e201fdc-5b3d-4692-add2-ce64c964f7c7 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-dca45777-d84e-4070-a212-c9242bc49b95-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "cinder-quobyte-3976f6f8-8cc0-4228-a49a-6118a344cdb8" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-3976f6f8-8cc0-4228-a49a-6118a344cdb8" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb34ecc-02c6-4ca4-8807-e9698a83636e]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:11:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:59 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 Sep 03 11:11:59 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:00 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8" returned: 0 in 0.404s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:00 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8 Sep 03 11:12:00 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:00 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-3976f6f8-8cc0-4228-a49a-6118a344cdb8" returned: 0 in 0.262s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-quobyte-3976f6f8-8cc0-4228-a49a-6118a344cdb8" released by "delete_volume" :: held 0.715s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Created reservations ['f7b7ce15-1829-42ca-b5e8-296d491940ee', 'd3cfdc84-6e87-4254-8a26-9bd82d6e8dcc', '3775cb41-8c4e-4991-9b15-38e2edf07dea', '022ab06a-d59e-4f12-8af8-0c68da37ade6'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:00 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:00 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:00 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.295s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Deleted volume successfully. Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0f1cd5ff-84bc-4fe7-87f0-ac5f29bd91a4 tempest-VolumeDependencyTests-1165443440 None] Lock "cinder-3976f6f8-8cc0-4228-a49a-6118a344cdb8-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Flow 'volume_create_manager' (ec07f54c-4450-4e33-9ce8-8a96a361e0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7bd7b2-9c99-49c3-babb-d44010682faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7bd7b2-9c99-49c3-babb-d44010682faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffba160f-0fb3-4221-ad91-6a4fc8c438eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd8696f7e43494b93d7efbd5deb2a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:01Z,use_quota=True,user_id='b16b1e19843442fcbeef0a5b961d31ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf5a79c9-b5a6-482c-8ab7-6b02c6270380),volume_type_id=cf5a79c9-b5a6-482c-8ab7-6b02c6270380)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb58f4b4-f328-486c-8af1-4e6768428456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb58f4b4-f328-486c-8af1-4e6768428456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97941f0-a769-4711-af6e-4647e0f1a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:00 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97941f0-a769-4711-af6e-4647e0f1a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffba160f-0fb3-4221-ad91-6a4fc8c438eb', 'volume_name': 'volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb', 'volume_size': 1, 'image_id': '2f1ca850-154f-4da9-8198-10d1c712cb1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f1ca850-154f-4da9-8198-10d1c712cb1e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c26ab6258b1e96c6bdb8379e0eba466', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2bd8696f7e43494b93d7efbd5deb2a69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be857f09d8e11663060dc1c4cabdfc7b6ba2340ab52118cd2e180aa8a3090ff44f78123b5a82881f5538af5021a2f2e613e3e6989ea062ac80206882982d74c7', 'id': '2f1ca850-154f-4da9-8198-10d1c712cb1e', 'created_at': datetime.datetime(2026, 9, 3, 9, 11, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f1ca850-154f-4da9-8198-10d1c712cb1e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02be3088-e406-461e-8143-a38341288099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02be3088-e406-461e-8143-a38341288099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb5db05-3cb2-4853-81cf-47f47a149cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Volume ffba160f-0fb3-4221-ad91-6a4fc8c438eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb', 'volume_size': 1, 'image_id': '2f1ca850-154f-4da9-8198-10d1c712cb1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f1ca850-154f-4da9-8198-10d1c712cb1e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c26ab6258b1e96c6bdb8379e0eba466', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2bd8696f7e43494b93d7efbd5deb2a69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be857f09d8e11663060dc1c4cabdfc7b6ba2340ab52118cd2e180aa8a3090ff44f78123b5a82881f5538af5021a2f2e613e3e6989ea062ac80206882982d74c7', 'id': '2f1ca850-154f-4da9-8198-10d1c712cb1e', 'created_at': datetime.datetime(2026, 9, 3, 9, 11, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f1ca850-154f-4da9-8198-10d1c712cb1e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Trying to clone ffba160f-0fb3-4221-ad91-6a4fc8c438eb from image 2f1ca850-154f-4da9-8198-10d1c712cb1e at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f1ca850-154f-4da9-8198-10d1c712cb1e', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:12:01 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Image download 0.00 MB at 0.00 MB/s Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a08945d-fa30-4b05-8b60-d9489966fbb9]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:01 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD Sep 03 11:12:01 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:01 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:01 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD Sep 03 11:12:01 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:02 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD" returned: 1 in 0.377s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:12:02 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Temporary image 2f1ca850-154f-4da9-8198-10d1c712cb1e is fetched for user b16b1e19843442fcbeef0a5b961d31ea. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:12:02 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ced512a-82ea-402f-8229-44e0428c5e11]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:02 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD Sep 03 11:12:02 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:02 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:02 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD Sep 03 11:12:02 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:03 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD" returned: 1 in 0.354s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffba160f-0fb3-4221-ad91-6a4fc8c438eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd8696f7e43494b93d7efbd5deb2a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:01Z,use_quota=True,user_id='b16b1e19843442fcbeef0a5b961d31ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf5a79c9-b5a6-482c-8ab7-6b02c6270380),volume_type_id=cf5a79c9-b5a6-482c-8ab7-6b02c6270380)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Creating volume ffba160f-0fb3-4221-ad91-6a4fc8c438eb {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:03 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:03 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb 1073741824 Sep 03 11:12:03 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:03 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb 1073741824" returned: 0 in 0.459s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:03 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb Sep 03 11:12:03 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:03 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb" returned: 0 in 0.263s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Attempting download of 2f1ca850-154f-4da9-8198-10d1c712cb1e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f1ca850-154f-4da9-8198-10d1c712cb1e', 'metadata': {}}])) to volume ffba160f-0fb3-4221-ad91-6a4fc8c438eb. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ec8d70-0e1b-4a5b-9690-a5fb18d8d13e]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f1ca850-154f-4da9-8198-10d1c712cb1e_1ig3tt4j {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:04 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f1ca850-154f-4da9-8198-10d1c712cb1e_1ig3tt4j Sep 03 11:12:04 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:04 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f1ca850-154f-4da9-8198-10d1c712cb1e_1ig3tt4j" returned: 0 in 0.342s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f1ca850-154f-4da9-8198-10d1c712cb1e_1ig3tt4j {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:04 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f1ca850-154f-4da9-8198-10d1c712cb1e_1ig3tt4j Sep 03 11:12:04 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Flow 'volume_create_manager' (e7d4b7f4-0e63-4bdb-b81a-3f780fdee772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5f16f8-f4a8-4a48-a4d2-9bc1b46cb457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5f16f8-f4a8-4a48-a4d2-9bc1b46cb457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884628645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec16c3b-c3e3-473e-9dc6-ae0d9845e213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de6eef62557e4bba9f851e45e1d64dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:04Z,use_quota=True,user_id='0682c2569c7f440296c756fd9e137f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e412e995-4e62-42ca-9687-5c8fe2136bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e412e995-4e62-42ca-9687-5c8fe2136bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2eb866-ce98-490c-9519-077b943e8b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:04 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2eb866-ce98-490c-9519-077b943e8b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec16c3b-c3e3-473e-9dc6-ae0d9845e213', 'volume_name': 'volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ed0fe0-b2c7-4630-8013-88b85aa95742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ed0fe0-b2c7-4630-8013-88b85aa95742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9fdd54-baa9-4364-833b-0cf1e7159f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:04 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Volume cec16c3b-c3e3-473e-9dc6-ae0d9845e213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213', 'volume_size': 1} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884628645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec16c3b-c3e3-473e-9dc6-ae0d9845e213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de6eef62557e4bba9f851e45e1d64dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:04Z,use_quota=True,user_id='0682c2569c7f440296c756fd9e137f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Creating volume cec16c3b-c3e3-473e-9dc6-ae0d9845e213 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:04 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f1ca850-154f-4da9-8198-10d1c712cb1e_1ig3tt4j" returned: 1 in 0.437s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f1ca850-154f-4da9-8198-10d1c712cb1e_1ig3tt4j' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7968e6b-8a2e-4433-b2d9-17e1dc269e6d]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:04 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 1073741824 Sep 03 11:12:04 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:04 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD Sep 03 11:12:04 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:05 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:05 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 1073741824" returned: 0 in 0.462s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:05 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD Sep 03 11:12:05 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:05 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 Sep 03 11:12:05 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:05 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] 2f1ca850-154f-4da9-8198-10d1c712cb1e was raw, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:05 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb Sep 03 11:12:05 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:05 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213" returned: 0 in 0.261s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9fdd54-baa9-4364-833b-0cf1e7159f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faedfed0-618d-4273-818b-49094b5d99b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:05 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Volume volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 (cec16c3b-c3e3-473e-9dc6-ae0d9845e213): created successfully Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faedfed0-618d-4273-818b-49094b5d99b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Flow 'volume_create_manager' (e7d4b7f4-0e63-4bdb-b81a-3f780fdee772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:05 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2d447d7b-6c5d-4e58-be8e-37d6d1ddf404 tempest-ProjectReaderTests-2083260951 None] Created volume successfully. Sep 03 11:12:05 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb" returned: 0 in 0.437s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f1ca850-154f-4da9-8198-10d1c712cb1e_hc3g4mj4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:12:05 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 11:12:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:05 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb 1G Sep 03 11:12:05 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:06 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb 1G" returned: 0 in 0.318s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Downloaded image 2f1ca850-154f-4da9-8198-10d1c712cb1e ((None, [{'url': 'file:///opt/stack/data/glance/images/2f1ca850-154f-4da9-8198-10d1c712cb1e', 'metadata': {}}])) to volume ffba160f-0fb3-4221-ad91-6a4fc8c438eb successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Temporary image 2f1ca850-154f-4da9-8198-10d1c712cb1e for user b16b1e19843442fcbeef0a5b961d31ea is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Marking volume ffba160f-0fb3-4221-ad91-6a4fc8c438eb as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Copying metadata from image 2f1ca850-154f-4da9-8198-10d1c712cb1e to ffba160f-0fb3-4221-ad91-6a4fc8c438eb. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Creating volume glance metadata for volume ffba160f-0fb3-4221-ad91-6a4fc8c438eb backed by image 2f1ca850-154f-4da9-8198-10d1c712cb1e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2f1ca850-154f-4da9-8198-10d1c712cb1e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0c26ab6258b1e96c6bdb8379e0eba466', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb5db05-3cb2-4853-81cf-47f47a149cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb', 'volume_size': 1, 'image_id': '2f1ca850-154f-4da9-8198-10d1c712cb1e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f1ca850-154f-4da9-8198-10d1c712cb1e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c26ab6258b1e96c6bdb8379e0eba466', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2bd8696f7e43494b93d7efbd5deb2a69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'be857f09d8e11663060dc1c4cabdfc7b6ba2340ab52118cd2e180aa8a3090ff44f78123b5a82881f5538af5021a2f2e613e3e6989ea062ac80206882982d74c7', 'id': '2f1ca850-154f-4da9-8198-10d1c712cb1e', 'created_at': datetime.datetime(2026, 9, 3, 9, 11, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f1ca850-154f-4da9-8198-10d1c712cb1e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7dcee2-b0ff-4202-89e4-2a144cf64a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:06 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Volume volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb (ffba160f-0fb3-4221-ad91-6a4fc8c438eb): created successfully Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7dcee2-b0ff-4202-89e4-2a144cf64a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Flow 'volume_create_manager' (ec07f54c-4450-4e33-9ce8-8a96a361e0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:06 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-538806b9-052e-4d7d-8b87-eb4bf604ed73 tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Created volume successfully. Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Acquiring lock "cinder-cec16c3b-c3e3-473e-9dc6-ae0d9845e213-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Lock "cinder-cec16c3b-c3e3-473e-9dc6-ae0d9845e213-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=79,cinder:INSERT=23,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=88,cinder:UPDATE=84,cinder:INSERT=24,cinder:DELETE=4 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Acquiring lock "cinder-quobyte-cec16c3b-c3e3-473e-9dc6-ae0d9845e213" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Lock "cinder-quobyte-cec16c3b-c3e3-473e-9dc6-ae0d9845e213" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eeab81-e7c0-4f8e-a2ab-e682a3c23396]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:06 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 Sep 03 11:12:06 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Acquiring lock "cinder-ffba160f-0fb3-4221-ad91-6a4fc8c438eb-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "cinder-ffba160f-0fb3-4221-ad91-6a4fc8c438eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:07 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213" returned: 0 in 0.384s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Acquiring lock "cinder-quobyte-ffba160f-0fb3-4221-ad91-6a4fc8c438eb" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:07 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213 Sep 03 11:12:07 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "cinder-quobyte-ffba160f-0fb3-4221-ad91-6a4fc8c438eb" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e49287-a1af-4916-b0f7-87d59dfb6cd7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:07 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb Sep 03 11:12:07 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:07 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cec16c3b-c3e3-473e-9dc6-ae0d9845e213" returned: 0 in 0.265s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Lock "cinder-quobyte-cec16c3b-c3e3-473e-9dc6-ae0d9845e213" released by "delete_volume" :: held 0.687s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Created reservations ['3fe637f0-fb15-46fe-ba5b-d017b01814a2', '5dd428da-1cb6-4c57-abd4-0e6915b478e8', '9895c189-21da-451e-81b6-998da7c840ca', '82ea895c-5f33-44e0-9cec-16522fe25241'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:07 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:07 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:07 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb" returned: 0 in 0.388s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:07 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb Sep 03 11:12:07 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:07 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.269s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:07 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Deleted volume successfully. Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-01ed9cf7-4571-44ee-b6a9-baf70d0af4e0 tempest-ProjectReaderTests-2083260951 None] Lock "cinder-cec16c3b-c3e3-473e-9dc6-ae0d9845e213-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:07 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ffba160f-0fb3-4221-ad91-6a4fc8c438eb" returned: 0 in 0.268s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "cinder-quobyte-ffba160f-0fb3-4221-ad91-6a4fc8c438eb" released by "delete_volume" :: held 0.697s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:07 devstack cinder-volume[86603]: WARNING cinder.quota [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:12:07 devstack cinder-volume[86603]: WARNING cinder.quota [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:12:07 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Created reservations ['de488b24-55c8-4ac4-a2d9-b371dc6559d8', 'c6a8435a-6486-4dfd-abe5-0c51a8e1f7cc', 'e120597d-afbd-4af8-a8af-40db9758f428', '12c112b1-2ae7-4b97-9dd0-ee826ddda479'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:08 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:08 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:08 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.272s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Deleted volume successfully. Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e4d94214-db9a-473d-af89-7db00e66793b tempest-VolumeAndVolumeTypeFromImageTest-909009717 None] Lock "cinder-ffba160f-0fb3-4221-ad91-6a4fc8c438eb-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Flow 'volume_create_manager' (85c920a5-450e-4e6e-a0f8-effb2b9cd278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dc3fe6-1f04-4863-8505-edf76370722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dc3fe6-1f04-4863-8505-edf76370722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653811872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b405fd12-5628-4f06-9296-f69054882a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de6eef62557e4bba9f851e45e1d64dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:08Z,use_quota=True,user_id='0682c2569c7f440296c756fd9e137f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d57d68-fe13-4900-bf5d-8cb7c56c8839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d57d68-fe13-4900-bf5d-8cb7c56c8839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735461c0-8949-4266-aedc-3348fe3ca80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735461c0-8949-4266-aedc-3348fe3ca80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b405fd12-5628-4f06-9296-f69054882a08', 'volume_name': 'volume-b405fd12-5628-4f06-9296-f69054882a08', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9fddc1-4ee1-4a9c-aef3-3dd9e4ab2c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9fddc1-4ee1-4a9c-aef3-3dd9e4ab2c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2def1e-0af7-42e1-b79a-6aad72de3efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:08 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Volume b405fd12-5628-4f06-9296-f69054882a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b405fd12-5628-4f06-9296-f69054882a08', 'volume_size': 1} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653811872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b405fd12-5628-4f06-9296-f69054882a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de6eef62557e4bba9f851e45e1d64dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:08Z,use_quota=True,user_id='0682c2569c7f440296c756fd9e137f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Creating volume b405fd12-5628-4f06-9296-f69054882a08 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:08 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:08 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08 1073741824 Sep 03 11:12:08 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:08 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08 1073741824" returned: 0 in 0.448s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:09 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08 Sep 03 11:12:09 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:09 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08" returned: 0 in 0.268s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2def1e-0af7-42e1-b79a-6aad72de3efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b405fd12-5628-4f06-9296-f69054882a08', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfcdfcb-1c71-40d3-be0b-dca88d5aba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:09 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Volume volume-b405fd12-5628-4f06-9296-f69054882a08 (b405fd12-5628-4f06-9296-f69054882a08): created successfully Sep 03 11:12:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfcdfcb-1c71-40d3-be0b-dca88d5aba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:09 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Flow 'volume_create_manager' (85c920a5-450e-4e6e-a0f8-effb2b9cd278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-181093b9-3252-4409-a01f-aa18b7d77cfc tempest-ProjectReaderTests-2083260951 None] Created volume successfully. Sep 03 11:12:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Acquiring lock "cinder-b405fd12-5628-4f06-9296-f69054882a08-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Lock "cinder-b405fd12-5628-4f06-9296-f69054882a08-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Acquiring lock "cinder-quobyte-b405fd12-5628-4f06-9296-f69054882a08" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Lock "cinder-quobyte-b405fd12-5628-4f06-9296-f69054882a08" acquired by "delete_volume" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c5fbf8-d48a-4e1a-b94a-b8563c65ad0d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:10 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08 Sep 03 11:12:10 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:11 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08" returned: 0 in 0.391s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:11 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08 Sep 03 11:12:11 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:11 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b405fd12-5628-4f06-9296-f69054882a08" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Lock "cinder-quobyte-b405fd12-5628-4f06-9296-f69054882a08" released by "delete_volume" :: held 0.691s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Created reservations ['e9e1bd7e-f23b-497a-899c-e98b150822d9', '68879a2e-a16e-44cf-83a1-c6885bc87971', '47d972df-2683-4a10-8b7a-2b985f156a18', '8dc00586-e484-4fd2-9f0d-13c02a06c430'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:11 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:11 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:11 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.268s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Deleted volume successfully. Sep 03 11:12:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-62e59bd2-dc51-456c-9c18-dd1c36eb3cd0 tempest-ProjectReaderTests-2083260951 None] Lock "cinder-b405fd12-5628-4f06-9296-f69054882a08-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:12 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (732ca81c-391a-44ec-a01f-2901e5b916bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95858de-49ae-405e-a6b6-ddf655bd9f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95858de-49ae-405e-a6b6-ddf655bd9f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663219382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7eeeea-7ad6-4bbf-8cde-47d123c68244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:13Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92789179-2fbc-410e-b134-c16bd5b4494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92789179-2fbc-410e-b134-c16bd5b4494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ab1814-f954-4fcd-ad68-2b95586bdb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ab1814-f954-4fcd-ad68-2b95586bdb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7eeeea-7ad6-4bbf-8cde-47d123c68244', 'volume_name': 'volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb70a7e-5cd7-451a-851d-a599d114ba37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb70a7e-5cd7-451a-851d-a599d114ba37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73684618-da72-40a5-9fe4-32627729c905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume ed7eeeea-7ad6-4bbf-8cde-47d123c68244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244', 'volume_size': 1} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663219382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7eeeea-7ad6-4bbf-8cde-47d123c68244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:13Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Creating volume ed7eeeea-7ad6-4bbf-8cde-47d123c68244 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:13 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:13 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 1073741824 Sep 03 11:12:13 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:13 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 1073741824" returned: 0 in 0.479s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:13 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 Sep 03 11:12:13 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:13 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73684618-da72-40a5-9fe4-32627729c905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ee5827-13d3-41e1-a667-b9217721afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:13 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 (ed7eeeea-7ad6-4bbf-8cde-47d123c68244): created successfully Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ee5827-13d3-41e1-a667-b9217721afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:13 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (732ca81c-391a-44ec-a01f-2901e5b916bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:13 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3ce75326-001e-4c7f-84e4-fc347307bb98 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created volume successfully. Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (ba4ef7a5-a6e1-455d-94c4-9a6b40708101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc62125-00a0-4c53-899b-d0bef1ddd4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc62125-00a0-4c53-899b-d0bef1ddd4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497472604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dd123e-37dc-4ca3-85fa-697301320633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:15Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8abcf8-0be0-4a9c-8d6b-d90c0785b599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8abcf8-0be0-4a9c-8d6b-d90c0785b599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270dc5c6-da45-4d65-bda3-1be49fa7585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270dc5c6-da45-4d65-bda3-1be49fa7585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17dd123e-37dc-4ca3-85fa-697301320633', 'volume_name': 'volume-17dd123e-37dc-4ca3-85fa-697301320633', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b7040a-dde6-46df-9891-d0dacb4960e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b7040a-dde6-46df-9891-d0dacb4960e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94d0d09-c41a-4b68-bd7c-6ef195e08522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume 17dd123e-37dc-4ca3-85fa-697301320633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17dd123e-37dc-4ca3-85fa-697301320633', 'volume_size': 1} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497472604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dd123e-37dc-4ca3-85fa-697301320633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:15Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Creating volume 17dd123e-37dc-4ca3-85fa-697301320633 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:15 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:15 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633 1073741824 Sep 03 11:12:15 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (0784a1cb-dbd1-49fe-8f2a-dd4450b9c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d220274-c031-4660-ad9c-04ede42b7187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d220274-c031-4660-ad9c-04ede42b7187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-149002449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a28dcd-1faa-44ee-8f8f-6020ecd6121c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:16Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d344e98-1fe7-4787-8246-36c999495c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d344e98-1fe7-4787-8246-36c999495c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02fa642-87ee-4933-b981-8e39f0ade69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02fa642-87ee-4933-b981-8e39f0ade69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a28dcd-1faa-44ee-8f8f-6020ecd6121c', 'volume_name': 'volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd86983a-375b-4000-a83d-24da7be32ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd86983a-375b-4000-a83d-24da7be32ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40203648-2461-461c-be8b-387524ff68c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:15 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume 25a28dcd-1faa-44ee-8f8f-6020ecd6121c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c', 'volume_size': 1} Sep 03 11:12:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:16 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633 1073741824" returned: 0 in 0.503s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:16 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633 Sep 03 11:12:16 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (3ac0068a-6958-46f2-b640-7631182a8482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6e060a-709d-40fc-a952-7c60939c578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6e060a-709d-40fc-a952-7c60939c578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-743706172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915ae838-63c7-4682-99ae-b91a1cb7fa17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:16Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080cec9c-dffb-468a-81a0-f0506124ae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080cec9c-dffb-468a-81a0-f0506124ae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e7dac6-40c8-4380-81a7-e4db180ab513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e7dac6-40c8-4380-81a7-e4db180ab513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915ae838-63c7-4682-99ae-b91a1cb7fa17', 'volume_name': 'volume-915ae838-63c7-4682-99ae-b91a1cb7fa17', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7430e1-703c-4917-be3e-2953ff86c5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7430e1-703c-4917-be3e-2953ff86c5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54477f5d-dbf1-403a-bbb0-dcfdbe1664e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume 915ae838-63c7-4682-99ae-b91a1cb7fa17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915ae838-63c7-4682-99ae-b91a1cb7fa17', 'volume_size': 1} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:16 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633" returned: 0 in 0.266s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-149002449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a28dcd-1faa-44ee-8f8f-6020ecd6121c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:16Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Creating volume 25a28dcd-1faa-44ee-8f8f-6020ecd6121c {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:16 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94d0d09-c41a-4b68-bd7c-6ef195e08522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17dd123e-37dc-4ca3-85fa-697301320633', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3226e5ff-e89c-4389-a32d-24b3274d8d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c 1073741824 Sep 03 11:12:16 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:16 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume volume-17dd123e-37dc-4ca3-85fa-697301320633 (17dd123e-37dc-4ca3-85fa-697301320633): created successfully Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3226e5ff-e89c-4389-a32d-24b3274d8d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (ba4ef7a5-a6e1-455d-94c4-9a6b40708101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9d2c0ab1-611b-4ed7-a0cd-44f0d6754c8c tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created volume successfully. Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (c728ba2b-e573-4b0b-9db4-d15b7262562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfada67-b526-41fc-af8f-d1f92367a89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfada67-b526-41fc-af8f-d1f92367a89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1434665632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c104bb41-9e06-42fd-927b-90a802b4de06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:17Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27d1498-a6f3-4960-ae40-51ac1c8880b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27d1498-a6f3-4960-ae40-51ac1c8880b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dffbaa-dc54-4867-be6a-b219bff9600c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5dffbaa-dc54-4867-be6a-b219bff9600c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c104bb41-9e06-42fd-927b-90a802b4de06', 'volume_name': 'volume-c104bb41-9e06-42fd-927b-90a802b4de06', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eea162-e8b6-4088-8482-917db7191da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eea162-e8b6-4088-8482-917db7191da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74dfac1-5be8-4e39-8d29-dfd29ef94860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:16 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume c104bb41-9e06-42fd-927b-90a802b4de06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c104bb41-9e06-42fd-927b-90a802b4de06', 'volume_size': 1} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:16 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c 1073741824" returned: 0 in 0.485s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:16 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c Sep 03 11:12:16 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (76e89134-6ccc-4350-b2b4-8f435e116475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7beef053-4913-4e03-a7b9-5ad0c3b68c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7beef053-4913-4e03-a7b9-5ad0c3b68c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-347259932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cd2bfa-dac2-4898-b267-3d04ea8a751f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:17Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1f3274-3b2b-4727-a48c-067f09ba4d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1f3274-3b2b-4727-a48c-067f09ba4d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f4c6da-20e2-48df-b3cc-4608de859dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f4c6da-20e2-48df-b3cc-4608de859dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72cd2bfa-dac2-4898-b267-3d04ea8a751f', 'volume_name': 'volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9488da-12ba-4923-9837-889d68644453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9488da-12ba-4923-9837-889d68644453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f64d66a-491a-41ce-913e-e7765bd59b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:17 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume 72cd2bfa-dac2-4898-b267-3d04ea8a751f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f', 'volume_size': 1} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:17 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c" returned: 0 in 0.247s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-743706172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915ae838-63c7-4682-99ae-b91a1cb7fa17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:16Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Creating volume 915ae838-63c7-4682-99ae-b91a1cb7fa17 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:17 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40203648-2461-461c-be8b-387524ff68c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:17 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 1073741824 Sep 03 11:12:17 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b947501-c35a-48b6-a0bd-57f4a9c43a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:17 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c (25a28dcd-1faa-44ee-8f8f-6020ecd6121c): created successfully Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b947501-c35a-48b6-a0bd-57f4a9c43a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (0784a1cb-dbd1-49fe-8f2a-dd4450b9c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-fbc2cb63-b91d-4b07-9f87-5428877c2587 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created volume successfully. Sep 03 11:12:17 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 1073741824" returned: 0 in 0.404s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:17 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 Sep 03 11:12:17 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:17 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17" returned: 0 in 0.244s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.204s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1434665632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c104bb41-9e06-42fd-927b-90a802b4de06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:17Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Creating volume c104bb41-9e06-42fd-927b-90a802b4de06 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:17 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54477f5d-dbf1-403a-bbb0-dcfdbe1664e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915ae838-63c7-4682-99ae-b91a1cb7fa17', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4646433-70e6-414d-86a4-099d8ee779ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:17 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06 1073741824 Sep 03 11:12:17 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:17 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 (915ae838-63c7-4682-99ae-b91a1cb7fa17): created successfully Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4646433-70e6-414d-86a4-099d8ee779ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (3ac0068a-6958-46f2-b640-7631182a8482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9fd8a1cb-184b-431c-8506-6de2e98b0228 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created volume successfully. Sep 03 11:12:18 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06 1073741824" returned: 0 in 0.407s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:18 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06 Sep 03 11:12:18 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:18 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06" returned: 0 in 0.242s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-347259932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cd2bfa-dac2-4898-b267-3d04ea8a751f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4019a6e4c1041caa8dd7d315f68e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:17Z,use_quota=True,user_id='d7d22baec1fe40de95edd679f68e18d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Creating volume 72cd2bfa-dac2-4898-b267-3d04ea8a751f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:18 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:18 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f 1073741824 Sep 03 11:12:18 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74dfac1-5be8-4e39-8d29-dfd29ef94860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c104bb41-9e06-42fd-927b-90a802b4de06', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8906b22d-6b86-41a8-ac25-70c0784fcd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:18 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume volume-c104bb41-9e06-42fd-927b-90a802b4de06 (c104bb41-9e06-42fd-927b-90a802b4de06): created successfully Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8906b22d-6b86-41a8-ac25-70c0784fcd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (c728ba2b-e573-4b0b-9db4-d15b7262562d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-66695b3f-b433-4863-bfe4-3cd26251737f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created volume successfully. Sep 03 11:12:19 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f 1073741824" returned: 0 in 0.404s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:19 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f Sep 03 11:12:19 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:19 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f" returned: 0 in 0.247s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f64d66a-491a-41ce-913e-e7765bd59b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0142cb7c-9ab0-4603-98f5-f81010b0fcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:19 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Volume volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f (72cd2bfa-dac2-4898-b267-3d04ea8a751f): created successfully Sep 03 11:12:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0142cb7c-9ab0-4603-98f5-f81010b0fcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Flow 'volume_create_manager' (76e89134-6ccc-4350-b2b4-8f435e116475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:19 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-dace2d0f-e611-4b7c-b03a-65cc9ca0d378 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created volume successfully. Sep 03 11:12:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-72cd2bfa-dac2-4898-b267-3d04ea8a751f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-72cd2bfa-dac2-4898-b267-3d04ea8a751f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-quobyte-72cd2bfa-dac2-4898-b267-3d04ea8a751f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:20 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-72cd2bfa-dac2-4898-b267-3d04ea8a751f" acquired by "delete_volume" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[12de42bf-122f-4124-8310-385501be8a40]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:20 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f Sep 03 11:12:20 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:20 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f" returned: 0 in 0.358s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:20 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f Sep 03 11:12:20 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:21 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-72cd2bfa-dac2-4898-b267-3d04ea8a751f" returned: 0 in 0.246s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-72cd2bfa-dac2-4898-b267-3d04ea8a751f" released by "delete_volume" :: held 0.644s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created reservations ['861d95ff-6bc5-489f-8238-ee98b55ac4a8', '80231f7a-a155-4e65-8332-4245392d7f30', '9209b7b2-4a1f-4ad1-8952-237fcff8a6d6', 'f7649594-a161-4bc6-8021-3ce02dcfe445'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:21 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:21 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:21 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.238s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:21 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Deleted volume successfully. Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-291a99a1-afd2-431e-96f4-2fe4885b7806 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-72cd2bfa-dac2-4898-b267-3d04ea8a751f-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-c104bb41-9e06-42fd-927b-90a802b4de06-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-c104bb41-9e06-42fd-927b-90a802b4de06-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-quobyte-c104bb41-9e06-42fd-927b-90a802b4de06" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-c104bb41-9e06-42fd-927b-90a802b4de06" acquired by "delete_volume" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f096522-1650-43c0-b19c-02eb43f3f843]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:21 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06 Sep 03 11:12:21 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:21 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06" returned: 0 in 0.354s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:22 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06 Sep 03 11:12:22 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:22 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c104bb41-9e06-42fd-927b-90a802b4de06" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-c104bb41-9e06-42fd-927b-90a802b4de06" released by "delete_volume" :: held 0.645s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created reservations ['f8c2d8f5-a753-4010-b68f-b4d7a8397b22', '7aacee37-c5d3-46bc-890c-f918f4d29af4', 'cf53a348-2990-428a-ba07-c723b4287096', '8a47a562-dfc1-4c3e-a4cf-604d7c566665'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:22 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:22 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:22 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.254s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:22 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Deleted volume successfully. Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3f26ba1e-07ed-40f9-82db-4aecade7c779 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-c104bb41-9e06-42fd-927b-90a802b4de06-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-915ae838-63c7-4682-99ae-b91a1cb7fa17-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-915ae838-63c7-4682-99ae-b91a1cb7fa17-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-quobyte-915ae838-63c7-4682-99ae-b91a1cb7fa17" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-915ae838-63c7-4682-99ae-b91a1cb7fa17" acquired by "delete_volume" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dbfaa3-75bc-4a24-80c8-760915805ba7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:22 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 Sep 03 11:12:22 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:23 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17" returned: 0 in 0.353s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:23 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17 Sep 03 11:12:23 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:23 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-915ae838-63c7-4682-99ae-b91a1cb7fa17" returned: 0 in 0.242s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-915ae838-63c7-4682-99ae-b91a1cb7fa17" released by "delete_volume" :: held 0.631s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created reservations ['fde1180f-0129-4c9b-9a28-d900ad51fe7d', '00d7ec5f-f606-433b-9a31-92252d00ab17', '716d06ad-4b3e-4a42-ace0-c7b244f86060', '0f5e05de-56dc-4ac2-8fd2-8f4414ccffd2'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:23 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:23 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:23 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:23 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:23 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.250s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:12:23 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.257s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:23 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Deleted volume successfully. Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-25a28dcd-1faa-44ee-8f8f-6020ecd6121c-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b88ff7d6-59ab-46ea-bf30-79f6be224859 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-915ae838-63c7-4682-99ae-b91a1cb7fa17-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-25a28dcd-1faa-44ee-8f8f-6020ecd6121c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-quobyte-25a28dcd-1faa-44ee-8f8f-6020ecd6121c" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-25a28dcd-1faa-44ee-8f8f-6020ecd6121c" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[358a87e8-31c9-4d7f-9bcd-e2c81efe1ebc]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:24 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c Sep 03 11:12:24 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:24 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c" returned: 0 in 0.370s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:24 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c Sep 03 11:12:24 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:24 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-25a28dcd-1faa-44ee-8f8f-6020ecd6121c" returned: 0 in 0.249s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-25a28dcd-1faa-44ee-8f8f-6020ecd6121c" released by "delete_volume" :: held 0.658s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created reservations ['3b31698f-5d57-443b-be1c-63384c87485c', 'a6ec04d5-cd8c-4b71-9a32-77b198479f22', 'e331cada-8c4e-4546-ab79-e04025e06973', 'bddc71a8-97e4-4389-9516-11b647ab1cb8'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:24 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:24 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:24 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.248s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:24 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:24 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Deleted volume successfully. Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f6d927d2-4234-47b7-bbcc-0e040553b9f6 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-25a28dcd-1faa-44ee-8f8f-6020ecd6121c-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-17dd123e-37dc-4ca3-85fa-697301320633-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-17dd123e-37dc-4ca3-85fa-697301320633-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-quobyte-17dd123e-37dc-4ca3-85fa-697301320633" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-17dd123e-37dc-4ca3-85fa-697301320633" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[218236b9-cd18-4690-b81c-2d0a2128e985]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:25 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633 Sep 03 11:12:25 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:25 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633" returned: 0 in 0.345s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:25 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633 Sep 03 11:12:25 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:25 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-17dd123e-37dc-4ca3-85fa-697301320633" returned: 0 in 0.250s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-17dd123e-37dc-4ca3-85fa-697301320633" released by "delete_volume" :: held 0.630s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created reservations ['4eeaf8d4-51d2-4e8a-944f-c888b96a5bd0', '7c70df38-f31a-4d1d-8751-514c6a39b64b', '9b58f684-7e6d-47c3-9b1c-6adab3038a99', '3110fecc-6a6f-4dbc-bd6c-135a64213aa8'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:25 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:25 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:26 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.249s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:26 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Deleted volume successfully. Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6e66afba-c85b-490b-96d7-860c09b5a59f tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-17dd123e-37dc-4ca3-85fa-697301320633-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-ed7eeeea-7ad6-4bbf-8cde-47d123c68244-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-ed7eeeea-7ad6-4bbf-8cde-47d123c68244-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "cinder-quobyte-ed7eeeea-7ad6-4bbf-8cde-47d123c68244" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-ed7eeeea-7ad6-4bbf-8cde-47d123c68244" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e75df6-7b66-4bd3-a990-8d63fce3ced1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:26 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 Sep 03 11:12:26 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:26 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244" returned: 0 in 0.359s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:26 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244 Sep 03 11:12:26 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:26 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ed7eeeea-7ad6-4bbf-8cde-47d123c68244" returned: 0 in 0.245s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-quobyte-ed7eeeea-7ad6-4bbf-8cde-47d123c68244" released by "delete_volume" :: held 0.641s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Created reservations ['faec6ae2-39ea-4ff2-8118-5283d25c1ad0', '097142d0-5080-4e84-9944-53e3e67bc321', '7f9c98de-8c11-4d89-b395-4ee1e4654e69', 'e254bccd-7849-497f-8752-33824bb00a17'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:27 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:27 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:27 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.247s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:27 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:27 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Deleted volume successfully. Sep 03 11:12:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7672bc5b-abe8-41d0-9002-d4f2b7d9f529 tempest-CreateVolumesFromSourceVolumeTest-1421360247 None] Lock "cinder-ed7eeeea-7ad6-4bbf-8cde-47d123c68244-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:36 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=52,cinder:INSERT=19,cinder:UPDATE=95,cinder:DELETE=5 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:12:37 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=65,cinder:UPDATE=90,cinder:INSERT=24,cinder:DELETE=11 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Flow 'volume_create_manager' (88c7851a-2a94-4832-8da4-fabf6306f707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbe7361-1871-438b-a0a4-d4b3b6ba7c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbe7361-1871-438b-a0a4-d4b3b6ba7c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9917ce01-4255-46a9-9763-d34b3686cfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2666cb189ab486c81b9c3a2942a805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:43Z,use_quota=True,user_id='05e0cfb6b6114689b07e580628bd5035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f77d82-1df7-465f-9341-6d16223d2465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f77d82-1df7-465f-9341-6d16223d2465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e91991-fb71-41ca-ba40-cf9b37c6c60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e91991-fb71-41ca-ba40-cf9b37c6c60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9917ce01-4255-46a9-9763-d34b3686cfa6', 'volume_name': 'volume-9917ce01-4255-46a9-9763-d34b3686cfa6', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2231c2-41b0-4d2b-be41-148419b93e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2231c2-41b0-4d2b-be41-148419b93e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17097617-d25d-470a-82dc-9511fece8f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Volume 9917ce01-4255-46a9-9763-d34b3686cfa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9917ce01-4255-46a9-9763-d34b3686cfa6', 'volume_size': 1} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9917ce01-4255-46a9-9763-d34b3686cfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2666cb189ab486c81b9c3a2942a805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:43Z,use_quota=True,user_id='05e0cfb6b6114689b07e580628bd5035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Creating volume 9917ce01-4255-46a9-9763-d34b3686cfa6 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:43 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:43 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6 1073741824 Sep 03 11:12:43 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (2f089f95-f7fa-4776-b1b5-2e50d0a527b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c34926-533e-47c1-a57e-04c346dfa8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c34926-533e-47c1-a57e-04c346dfa8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-640392956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfd1a53-72b8-4bbc-92fd-ea8f2b346820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:44Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92428d66-05f2-4b9b-beb0-22812da7284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92428d66-05f2-4b9b-beb0-22812da7284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3f2cc2-b813-4e01-af3c-187fc4a9c4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3f2cc2-b813-4e01-af3c-187fc4a9c4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfd1a53-72b8-4bbc-92fd-ea8f2b346820', 'volume_name': 'volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced23ea6-10e7-41dc-a111-bfaf4053ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced23ea6-10e7-41dc-a111-bfaf4053ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f7e23b-fe2a-4cc5-a3c6-a89471252cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:43 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Volume 6cfd1a53-72b8-4bbc-92fd-ea8f2b346820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820', 'volume_size': 1} Sep 03 11:12:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (d17bc92b-154d-41af-8cd8-edf414c787de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17eb2d7-b138-4d61-899a-e87d84d6c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17eb2d7-b138-4d61-899a-e87d84d6c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841923506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdb74f0-5a28-4267-9d28-36006629ec7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:44Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7a29f8-3e7e-4ae0-9e26-1132955fe1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7a29f8-3e7e-4ae0-9e26-1132955fe1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b6f9c2-a170-45ee-9f1a-5fcff9b88893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b6f9c2-a170-45ee-9f1a-5fcff9b88893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cdb74f0-5a28-4267-9d28-36006629ec7a', 'volume_name': 'volume-4cdb74f0-5a28-4267-9d28-36006629ec7a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376dbaa5-dd16-42f8-a036-23f12cdbddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376dbaa5-dd16-42f8-a036-23f12cdbddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038e1a5e-92c5-4006-b651-114b522a4fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Volume 4cdb74f0-5a28-4267-9d28-36006629ec7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cdb74f0-5a28-4267-9d28-36006629ec7a', 'volume_size': 1} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:44 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6 1073741824" returned: 0 in 0.633s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:44 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6 Sep 03 11:12:44 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (dc29b14c-abf1-482d-8dad-3226a320e2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c094a0be-5c9a-4312-97cb-7064e5a9a30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (32b5ea87-f262-40ef-b1de-36801dc083d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb12d7b3-b377-4a1f-ad0f-4a9c69678074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c094a0be-5c9a-4312-97cb-7064e5a9a30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822227195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa71ba6-825c-4aba-a5c2-d61d529d96ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:44Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7004d279-4179-4090-96ed-5f3fcb7410e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7004d279-4179-4090-96ed-5f3fcb7410e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12fb33f-63ce-4cbb-8a20-0769d9b42d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12fb33f-63ce-4cbb-8a20-0769d9b42d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa71ba6-825c-4aba-a5c2-d61d529d96ad', 'volume_name': 'volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819a6584-a475-4fa9-beb7-b559b36b8d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819a6584-a475-4fa9-beb7-b559b36b8d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0318a1f1-3b5f-46b6-b70a-eb40c10de616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume cfa71ba6-825c-4aba-a5c2-d61d529d96ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad', 'volume_size': 1} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6" returned: 0 in 0.393s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-640392956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfd1a53-72b8-4bbc-92fd-ea8f2b346820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:44Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Creating volume 6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:44 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb12d7b3-b377-4a1f-ad0f-4a9c69678074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612053453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45252f6-bd4f-4755-9562-f60b6fc85ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:45Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b37418a-4e33-48fe-b156-0971a0da8276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 1073741824 Sep 03 11:12:44 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b37418a-4e33-48fe-b156-0971a0da8276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50e44c0-1998-40ab-abea-531350cf6727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50e44c0-1998-40ab-abea-531350cf6727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a45252f6-bd4f-4755-9562-f60b6fc85ffe', 'volume_name': 'volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc2f2b6-4e85-4980-b334-8509802f846a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc2f2b6-4e85-4980-b334-8509802f846a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f390285-3dbb-41d9-986c-cad457f59587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Volume a45252f6-bd4f-4755-9562-f60b6fc85ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe', 'volume_size': 1} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17097617-d25d-470a-82dc-9511fece8f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9917ce01-4255-46a9-9763-d34b3686cfa6', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a840dc53-fcfd-4994-b661-38b2d542c37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Volume volume-9917ce01-4255-46a9-9763-d34b3686cfa6 (9917ce01-4255-46a9-9763-d34b3686cfa6): created successfully Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a840dc53-fcfd-4994-b661-38b2d542c37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Flow 'volume_create_manager' (88c7851a-2a94-4832-8da4-fabf6306f707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:45 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1187a48b-a194-4c8c-831f-e3c080a40496 tempest-CinderUnicodeTest-376686311 None] Created volume successfully. Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (3f74fb7f-886d-4767-b0fc-41fd3d488168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50423672-67b3-4b53-8629-c5ce9c2b5a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50423672-67b3-4b53-8629-c5ce9c2b5a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023612676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695b5089-7d68-4e11-8a5b-025837074fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:45Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cd2f06-8884-4d14-b73b-e650324a1def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cd2f06-8884-4d14-b73b-e650324a1def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23353830-2c5e-4544-9af4-e57ae475cbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23353830-2c5e-4544-9af4-e57ae475cbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695b5089-7d68-4e11-8a5b-025837074fd2', 'volume_name': 'volume-695b5089-7d68-4e11-8a5b-025837074fd2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb782ff-6d8e-482e-bd1f-f726c46cc590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb782ff-6d8e-482e-bd1f-f726c46cc590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64afec4f-db62-4b38-9662-8ddcdea58fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Volume 695b5089-7d68-4e11-8a5b-025837074fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695b5089-7d68-4e11-8a5b-025837074fd2', 'volume_size': 1} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:45 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 1073741824" returned: 0 in 0.696s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:45 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 Sep 03 11:12:45 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (cd10d099-3777-4f64-8bc5-b596de37d679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7c425f-76fa-41c9-bd47-551b36807b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7c425f-76fa-41c9-bd47-551b36807b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1103354252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ffb88d-b2eb-492e-b23b-9bec68058d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:46Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a63a3b-38fb-493d-b484-d2a3a1a1ef79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a63a3b-38fb-493d-b484-d2a3a1a1ef79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63131252-94da-43ec-80fc-fbeff804ec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63131252-94da-43ec-80fc-fbeff804ec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1ffb88d-b2eb-492e-b23b-9bec68058d05', 'volume_name': 'volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dab420-d2d6-40ac-b19d-0540b3bb5494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dab420-d2d6-40ac-b19d-0540b3bb5494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701f9239-077c-4102-a468-159687f18afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Volume a1ffb88d-b2eb-492e-b23b-9bec68058d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05', 'volume_size': 1} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:45 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820" returned: 0 in 0.262s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841923506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdb74f0-5a28-4267-9d28-36006629ec7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:44Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Creating volume 4cdb74f0-5a28-4267-9d28-36006629ec7a {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:45 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f7e23b-fe2a-4cc5-a3c6-a89471252cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3818a689-53dd-4f81-8f05-43502d5ba312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:45 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a 1073741824 Sep 03 11:12:45 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:45 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Volume volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 (6cfd1a53-72b8-4bbc-92fd-ea8f2b346820): created successfully Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3818a689-53dd-4f81-8f05-43502d5ba312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:45 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (2f089f95-f7fa-4776-b1b5-2e50d0a527b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:46 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-17874d6a-4fc3-45be-aa5a-a56fcf82197f tempest-CreateVolumesFromImageTest-1188790893 None] Created volume successfully. Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Flow 'volume_create_manager' (d0025960-8fec-4bc5-b177-57598f902331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d057e4-a8be-4a2e-9143-60e7e576a0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d057e4-a8be-4a2e-9143-60e7e576a0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-303495117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6300224c-3d28-4db8-80c1-af9a13738e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2666cb189ab486c81b9c3a2942a805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:46Z,use_quota=True,user_id='05e0cfb6b6114689b07e580628bd5035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21e9df1-7e07-41fd-9146-a5f2994ea2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21e9df1-7e07-41fd-9146-a5f2994ea2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62a3ad1-8f05-4094-9dee-f6255ef6fd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62a3ad1-8f05-4094-9dee-f6255ef6fd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6300224c-3d28-4db8-80c1-af9a13738e94', 'volume_name': 'volume-6300224c-3d28-4db8-80c1-af9a13738e94', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd30a37-aeeb-484c-87a0-85271d86596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd30a37-aeeb-484c-87a0-85271d86596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71151911-c651-4b4f-a3d0-d8d1e1e1d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:46 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:46 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Volume 6300224c-3d28-4db8-80c1-af9a13738e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6300224c-3d28-4db8-80c1-af9a13738e94', 'volume_size': 1} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a 1073741824" returned: 0 in 0.522s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:46 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a Sep 03 11:12:46 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:46 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a" returned: 0 in 0.309s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.931s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822227195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa71ba6-825c-4aba-a5c2-d61d529d96ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:44Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Creating volume cfa71ba6-825c-4aba-a5c2-d61d529d96ad {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:46 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038e1a5e-92c5-4006-b651-114b522a4fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cdb74f0-5a28-4267-9d28-36006629ec7a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:46 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad 1073741824 Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2288c85e-43c0-4798-afd3-1e1d2f618e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:46 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:46 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Volume volume-4cdb74f0-5a28-4267-9d28-36006629ec7a (4cdb74f0-5a28-4267-9d28-36006629ec7a): created successfully Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2288c85e-43c0-4798-afd3-1e1d2f618e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:46 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (d17bc92b-154d-41af-8cd8-edf414c787de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:46 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-845ff0fb-f3ae-4628-9081-6134a669800d tempest-CreateVolumesFromImageTest-1188790893 None] Created volume successfully. Sep 03 11:12:47 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad 1073741824" returned: 0 in 0.468s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:47 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad Sep 03 11:12:47 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:47 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" returned: 0 in 0.265s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.591s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612053453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45252f6-bd4f-4755-9562-f60b6fc85ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:45Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Creating volume a45252f6-bd4f-4755-9562-f60b6fc85ffe {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:47 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:47 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe 1073741824 Sep 03 11:12:47 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0318a1f1-3b5f-46b6-b70a-eb40c10de616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d4245a-ab05-4099-858b-8fd48b4bca88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:47 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad (cfa71ba6-825c-4aba-a5c2-d61d529d96ad): created successfully Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d4245a-ab05-4099-858b-8fd48b4bca88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (dc29b14c-abf1-482d-8dad-3226a320e2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7f8f1747-79c7-4f00-873a-0a4cf8e365fc tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created volume successfully. Sep 03 11:12:48 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe 1073741824" returned: 0 in 0.428s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:48 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe Sep 03 11:12:48 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:48 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe" returned: 0 in 0.261s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.948s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023612676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695b5089-7d68-4e11-8a5b-025837074fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:45Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Creating volume 695b5089-7d68-4e11-8a5b-025837074fd2 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:48 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f390285-3dbb-41d9-986c-cad457f59587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:48 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2 1073741824 Sep 03 11:12:48 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce33dda-cffc-4393-beac-10f8801297b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Flow 'volume_create_manager' (4815700f-d257-4cde-9bec-36f6d80d4c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facb3a2d-e600-4e11-8dc7-8375f63a2891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:48 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Volume volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe (a45252f6-bd4f-4755-9562-f60b6fc85ffe): created successfully Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce33dda-cffc-4393-beac-10f8801297b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (32b5ea87-f262-40ef-b1de-36801dc083d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (facb3a2d-e600-4e11-8dc7-8375f63a2891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d0969a-04df-4f7d-b17e-140bbf58023d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4157adb66cf04f4696d532cf846644f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:48Z,use_quota=True,user_id='abcf6e368fc54af1a22e5418ac3e4512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a37fd800-3477-41bf-ab92-01f9f1c3bf31),volume_type_id=a37fd800-3477-41bf-ab92-01f9f1c3bf31)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c5f0cb-1793-4eb1-8d59-e7cd1c19994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c5f0cb-1793-4eb1-8d59-e7cd1c19994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bb79a9-2896-49da-833c-ffee04d423f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:12:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-aa9af4dc-6fb7-4d04-9600-7012c9a6522d tempest-CreateVolumesFromImageTest-1188790893 None] Created volume successfully. Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bb79a9-2896-49da-833c-ffee04d423f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81d0969a-04df-4f7d-b17e-140bbf58023d', 'volume_name': 'volume-81d0969a-04df-4f7d-b17e-140bbf58023d', 'volume_size': 1, 'image_id': 'c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '664bd140aee6d7f9e0dd9efabd5a9381', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4157adb66cf04f4696d532cf846644f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25fc097cda487ea0b8eb7ec204478e34881b2f87a3bacb1ca12941395b1a0125bddc08564db1bd75bbe7b907d3bf4417061c3d9f2fd694c39458a9e6114adf8e', 'id': 'c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'created_at': datetime.datetime(2026, 9, 3, 9, 12, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 12, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572ec960-6f11-48b3-828f-cf1c25d521a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572ec960-6f11-48b3-828f-cf1c25d521a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3de3516-4baa-409c-94dc-5e58b4cf6d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:48 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Volume 81d0969a-04df-4f7d-b17e-140bbf58023d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81d0969a-04df-4f7d-b17e-140bbf58023d', 'volume_size': 1, 'image_id': 'c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '664bd140aee6d7f9e0dd9efabd5a9381', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4157adb66cf04f4696d532cf846644f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25fc097cda487ea0b8eb7ec204478e34881b2f87a3bacb1ca12941395b1a0125bddc08564db1bd75bbe7b907d3bf4417061c3d9f2fd694c39458a9e6114adf8e', 'id': 'c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'created_at': datetime.datetime(2026, 9, 3, 9, 12, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 12, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Trying to clone 81d0969a-04df-4f7d-b17e-140bbf58023d from image c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:12:48 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Image download 0.00 MB at 0.00 MB/s Sep 03 11:12:48 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2 1073741824" returned: 0 in 0.500s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f782ad3e-3711-43f9-9bc5-b6fbf54171a4]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:48 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2 Sep 03 11:12:48 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:49 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD Sep 03 11:12:49 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:49 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2" returned: 0 in 0.327s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.379s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1103354252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ffb88d-b2eb-492e-b23b-9bec68058d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83417e0c49ef4d72b785eaeb9b5d6630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:46Z,use_quota=True,user_id='4953a1da1b2b497fad5bb5c5a61934c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Creating volume a1ffb88d-b2eb-492e-b23b-9bec68058d05 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:49 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64afec4f-db62-4b38-9662-8ddcdea58fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695b5089-7d68-4e11-8a5b-025837074fd2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4a3d37-563c-4a4f-af4d-65ad87c5f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:49 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 1073741824 Sep 03 11:12:49 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:49 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Volume volume-695b5089-7d68-4e11-8a5b-025837074fd2 (695b5089-7d68-4e11-8a5b-025837074fd2): created successfully Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4a3d37-563c-4a4f-af4d-65ad87c5f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (3f74fb7f-886d-4767-b0fc-41fd3d488168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-de3aa706-0e76-4350-beed-6f5309f71be1 tempest-CreateVolumesFromImageTest-1188790893 None] Created volume successfully. Sep 03 11:12:49 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:49 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD Sep 03 11:12:49 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:49 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 1073741824" returned: 0 in 0.431s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:49 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Temporary image c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4 is fetched for user abcf6e368fc54af1a22e5418ac3e4512. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64d2802-a32b-4e75-ae29-f637c1c7fcd9]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:49 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 Sep 03 11:12:49 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:49 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD Sep 03 11:12:49 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:50 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05" returned: 0 in 0.286s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.622s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-303495117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6300224c-3d28-4db8-80c1-af9a13738e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2666cb189ab486c81b9c3a2942a805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:46Z,use_quota=True,user_id='05e0cfb6b6114689b07e580628bd5035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Creating volume 6300224c-3d28-4db8-80c1-af9a13738e94 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:50 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701f9239-077c-4102-a468-159687f18afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bbb433-6dee-4d89-a170-bcce35d6b92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:50 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 1073741824 Sep 03 11:12:50 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:50 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Volume volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 (a1ffb88d-b2eb-492e-b23b-9bec68058d05): created successfully Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bbb433-6dee-4d89-a170-bcce35d6b92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:50 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Flow 'volume_create_manager' (cd10d099-3777-4f64-8bc5-b596de37d679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:50 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c371f768-98f1-49fa-83d7-f8026b9ed35a tempest-CreateVolumesFromImageTest-1188790893 None] Created volume successfully. Sep 03 11:12:50 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD Sep 03 11:12:50 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:50 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:50 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 1073741824" returned: 0 in 0.483s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:50 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 Sep 03 11:12:50 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:50 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94" returned: 0 in 0.246s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.758s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71151911-c651-4b4f-a3d0-d8d1e1e1d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6300224c-3d28-4db8-80c1-af9a13738e94', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9219360d-cd8a-4c6e-bfe0-aa7396b3ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Creating offline snapshot 14561b6e-bf42-454a-9aff-e03387bdd340 of volume cfa71ba6-825c-4aba-a5c2-d61d529d96ad {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:12:50 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Volume volume-6300224c-3d28-4db8-80c1-af9a13738e94 (6300224c-3d28-4db8-80c1-af9a13738e94): created successfully Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9219360d-cd8a-4c6e-bfe0-aa7396b3ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Flow 'volume_create_manager' (d0025960-8fec-4bc5-b177-57598f902331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1f0de0-8f72-465a-b485-09c4a9560178]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:50 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9288085b-3af3-4cb3-aa2d-c07929c3da98 tempest-CinderUnicodeTest-376686311 None] Created volume successfully. Sep 03 11:12:51 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad Sep 03 11:12:51 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-a1ffb88d-b2eb-492e-b23b-9bec68058d05-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-a1ffb88d-b2eb-492e-b23b-9bec68058d05-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:51 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" returned: 0 in 0.378s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:51 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 1G Sep 03 11:12:51 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-quobyte-a1ffb88d-b2eb-492e-b23b-9bec68058d05" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-a1ffb88d-b2eb-492e-b23b-9bec68058d05" acquired by "delete_volume" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[950fb890-e4d4-4b76-9125-b0ea4f005517]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:51 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 Sep 03 11:12:51 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:51 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 1G" returned: 0 in 0.444s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:51 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 Sep 03 11:12:51 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:51 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05" returned: 0 in 0.415s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:51 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05 Sep 03 11:12:51 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:52 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340" returned: 0 in 0.315s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:52 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 is being set with open permissions: ugo+rw Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:52 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:52 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a1ffb88d-b2eb-492e-b23b-9bec68058d05" returned: 0 in 0.277s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:52 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-a1ffb88d-b2eb-492e-b23b-9bec68058d05" released by "delete_volume" :: held 0.740s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Created reservations ['9d7d8f4a-42a4-4c78-a21a-f10f05fa6ea3', 'ce4dc000-2470-47c6-9f06-0b9d649f9c2c', '50e69636-d51d-4025-8933-2e2ab26aca2d', '0dc817e2-3853-475b-b47c-0de9c6b10144'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:52 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:52 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:52 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:52 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.info Sep 03 11:12:52 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-695b5089-7d68-4e11-8a5b-025837074fd2-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-695b5089-7d68-4e11-8a5b-025837074fd2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:52 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.308s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:52 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Deleted volume successfully. Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-quobyte-695b5089-7d68-4e11-8a5b-025837074fd2" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-eae37899-62e6-4b35-91c5-0ab875d2cad6 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-a1ffb88d-b2eb-492e-b23b-9bec68058d05-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-695b5089-7d68-4e11-8a5b-025837074fd2" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f438a2-83c2-4dca-aa91-8352ed8f0a1b]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:52 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.info" returned: 0 in 0.315s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:52 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.info is being set with open permissions: ugo+rw Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:52 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.info Sep 03 11:12:52 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:52 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2 Sep 03 11:12:52 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:52 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.info" returned: 0 in 0.250s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.420s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d0969a-04df-4f7d-b17e-140bbf58023d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4157adb66cf04f4696d532cf846644f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:48Z,use_quota=True,user_id='abcf6e368fc54af1a22e5418ac3e4512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a37fd800-3477-41bf-ab92-01f9f1c3bf31),volume_type_id=a37fd800-3477-41bf-ab92-01f9f1c3bf31)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Creating volume 81d0969a-04df-4f7d-b17e-140bbf58023d {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:52 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:52 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:52 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d 1073741824 Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2" returned: 0 in 0.375s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:52 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:53 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-93c0841b-bb23-44e2-afd4-eaf0f1d8089c tempest-CreateVolumesFromSnapshotTest-1368763954 None] Create snapshot completed successfully Sep 03 11:12:53 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2 Sep 03 11:12:53 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:53 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-695b5089-7d68-4e11-8a5b-025837074fd2" returned: 0 in 0.265s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-695b5089-7d68-4e11-8a5b-025837074fd2" released by "delete_volume" :: held 0.682s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Created reservations ['0b91a7ca-0ee7-480e-a0c3-b49906d832a3', '8c35820f-8865-4c86-a2d5-86febd427055', '726144a0-2fbe-45e2-b6b3-7d390b30b000', 'c389a9b5-5b97-4472-864f-efb974d59aa3'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:53 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:53 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d 1073741824" returned: 0 in 0.493s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:53 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:53 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d Sep 03 11:12:53 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-a45252f6-bd4f-4755-9562-f60b6fc85ffe-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-a45252f6-bd4f-4755-9562-f60b6fc85ffe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:53 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-quobyte-a45252f6-bd4f-4755-9562-f60b6fc85ffe" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d" returned: 0 in 0.370s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.955s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:53 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (2506bcec-fc0e-4a4e-a384-d10dd5a15707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea12ad1-5221-485b-88bc-abf0a57254f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.510s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea12ad1-5221-485b-88bc-abf0a57254f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664129823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a12473-d92a-46ed-aed6-534d76002e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:54Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c222364-89b6-4fd2-b58e-ee58a3afb9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c222364-89b6-4fd2-b58e-ee58a3afb9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69ec5fa-6623-4797-88ce-e0b36ff78256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69ec5fa-6623-4797-88ce-e0b36ff78256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a12473-d92a-46ed-aed6-534d76002e5f', 'volume_name': 'volume-d5a12473-d92a-46ed-aed6-534d76002e5f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363634cc-59ca-4420-93e5-206b13b32c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363634cc-59ca-4420-93e5-206b13b32c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81b0519-a992-4a38-8c07-65361d7ef431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:53 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume d5a12473-d92a-46ed-aed6-534d76002e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a12473-d92a-46ed-aed6-534d76002e5f', 'volume_size': 1} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Creating offline snapshot 91befffb-4292-4fea-ae2e-82ff6c736c26 of volume 6300224c-3d28-4db8-80c1-af9a13738e94 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:12:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-a45252f6-bd4f-4755-9562-f60b6fc85ffe" acquired by "delete_volume" :: waited 0.132s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eef32a-9d32-47b8-9da8-649fd467eb7d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:54 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Deleted volume successfully. Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee975e0-365f-4083-bd48-0bc36200b35d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Attempting download of c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4 ((None, [{'url': 'file:///opt/stack/data/glance/images/c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'metadata': {}}])) to volume 81d0969a-04df-4f7d-b17e-140bbf58023d. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5e3287e5-f698-4d7a-a07a-18665c693b28 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-695b5089-7d68-4e11-8a5b-025837074fd2-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbedb15-54e9-4054-899e-f559f5daaba4]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4__3fjw65n {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:54 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe Sep 03 11:12:54 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 Sep 03 11:12:54 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:54 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:54 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4__3fjw65n Sep 03 11:12:54 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (60153774-f677-44bd-a001-0852f31321cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b36a68-4717-407b-a52e-06fe58dce66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b36a68-4717-407b-a52e-06fe58dce66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497094362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c487a12-2fa7-4d12-a92c-5f4cf21e35c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:54Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20840fb4-0812-4aca-8fcf-4ac92c7d8b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20840fb4-0812-4aca-8fcf-4ac92c7d8b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb54ee0-32b1-4cd9-a36e-702a6c3e066f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb54ee0-32b1-4cd9-a36e-702a6c3e066f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c487a12-2fa7-4d12-a92c-5f4cf21e35c0', 'volume_name': 'volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819502e1-d730-4791-9d63-323771b6721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819502e1-d730-4791-9d63-323771b6721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e038fc7-41fb-4850-aa4f-e5e7971bb9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:54 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume 1c487a12-2fa7-4d12-a92c-5f4cf21e35c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0', 'volume_size': 1} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:54 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94" returned: 0 in 0.493s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:54 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 1G Sep 03 11:12:54 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:54 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe" returned: 0 in 0.601s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:54 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe Sep 03 11:12:54 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:54 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4__3fjw65n" returned: 0 in 0.666s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4__3fjw65n {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (93e36b89-8c2d-413c-9201-ed122cd9334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08b5675-78b1-4848-b792-0df49b0df9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4__3fjw65n Sep 03 11:12:55 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08b5675-78b1-4848-b792-0df49b0df9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1964141183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac50bcb-100c-47cf-8d9c-208116b12830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:55Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71659974-7ce8-420d-98ef-fb1458d0057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71659974-7ce8-420d-98ef-fb1458d0057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed933f0c-bf9f-4381-9b3e-f12fcff40ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed933f0c-bf9f-4381-9b3e-f12fcff40ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac50bcb-100c-47cf-8d9c-208116b12830', 'volume_name': 'volume-0ac50bcb-100c-47cf-8d9c-208116b12830', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286604ed-b12f-411b-81fb-770d51bd6632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286604ed-b12f-411b-81fb-770d51bd6632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d67397d-574d-4b0e-a0dc-6d4f55e9384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume 0ac50bcb-100c-47cf-8d9c-208116b12830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac50bcb-100c-47cf-8d9c-208116b12830', 'volume_size': 1} Sep 03 11:12:55 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a45252f6-bd4f-4755-9562-f60b6fc85ffe" returned: 0 in 0.464s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-a45252f6-bd4f-4755-9562-f60b6fc85ffe" released by "delete_volume" :: held 1.142s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:55 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 1G" returned: 0 in 0.662s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6300224c-3d28-4db8-80c1-af9a13738e94 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:55 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6300224c-3d28-4db8-80c1-af9a13738e94 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 Sep 03 11:12:55 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Created reservations ['d97566e5-f4d3-4e56-a5c6-4c74c1b408fc', 'f6c1ff7c-b9b5-43e6-b7f6-f6382b990580', '9b2620cf-b575-4879-9faf-015b01414bd6', '6de71f69-ded7-4e5e-8aa3-d2f1c24919a7'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:55 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4__3fjw65n" returned: 1 in 0.562s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4__3fjw65n' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc015637-6927-4901-8a73-5ad3b461c899]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:55 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:55 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (4ae2a2ec-76be-4d3f-99f4-d3efbc5b4834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566b126e-92ab-464b-8d8a-15b9487bb729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD Sep 03 11:12:55 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566b126e-92ab-464b-8d8a-15b9487bb729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-965182558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c699b82-c2b7-4b3d-badf-7cd0c6eddac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:55Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825fd422-4c39-4494-93f5-035c50b4f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (825fd422-4c39-4494-93f5-035c50b4f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9889e014-d33e-4f18-a2e5-b87918a52550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9889e014-d33e-4f18-a2e5-b87918a52550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c699b82-c2b7-4b3d-badf-7cd0c6eddac2', 'volume_name': 'volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740d36b8-259f-4ae8-8668-5901f1b7c287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740d36b8-259f-4ae8-8668-5901f1b7c287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2daf2a5-d27a-4408-bc25-69c7642706b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume 2c699b82-c2b7-4b3d-badf-7cd0c6eddac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2', 'volume_size': 1} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:55 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6300224c-3d28-4db8-80c1-af9a13738e94 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26" returned: 0 in 0.517s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:55 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 is being set with open permissions: ugo+rw Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:55 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 Sep 03 11:12:55 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:55 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.296s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Deleted volume successfully. Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-751e48ee-43a9-4bdd-b722-21bb5a6249c1 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-a45252f6-bd4f-4755-9562-f60b6fc85ffe-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:55 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:55 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (44ba4a95-f47c-4ef8-8d81-e3ebd6b02373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a2b58b-68f8-45db-9df1-a2c98a964e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:56 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD Sep 03 11:12:56 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:56 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a2b58b-68f8-45db-9df1-a2c98a964e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1295622872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df7c5de-976e-4b44-b040-cde7d081eeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:56Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3969db74-be9f-49a0-8d4e-dcd4aff3eb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3969db74-be9f-49a0-8d4e-dcd4aff3eb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a2f043-1c35-49aa-9523-3586f6ad205f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a2f043-1c35-49aa-9523-3586f6ad205f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df7c5de-976e-4b44-b040-cde7d081eeeb', 'volume_name': 'volume-7df7c5de-976e-4b44-b040-cde7d081eeeb', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5440cc7c-dd1d-4903-911e-f96c218194cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5440cc7c-dd1d-4903-911e-f96c218194cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a099f2dd-52b4-41ca-a589-375a4008702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:56 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume 7df7c5de-976e-4b44-b040-cde7d081eeeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df7c5de-976e-4b44-b040-cde7d081eeeb', 'volume_size': 1} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26" returned: 0 in 0.424s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-4cdb74f0-5a28-4267-9d28-36006629ec7a-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-4cdb74f0-5a28-4267-9d28-36006629ec7a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:56 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.info Sep 03 11:12:56 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-quobyte-4cdb74f0-5a28-4267-9d28-36006629ec7a" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-4cdb74f0-5a28-4267-9d28-36006629ec7a" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f66bd6-827a-42f8-96de-f7da05eb515c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:56 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4 was raw, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:56 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d Sep 03 11:12:56 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:56 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a Sep 03 11:12:56 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:56 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.info" returned: 0 in 0.328s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:56 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.info is being set with open permissions: ugo+rw Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:56 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.info Sep 03 11:12:56 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:56 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a" returned: 0 in 0.416s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:56 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a Sep 03 11:12:56 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:56 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.info" returned: 0 in 0.275s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:56 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.810s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664129823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a12473-d92a-46ed-aed6-534d76002e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:54Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Creating volume d5a12473-d92a-46ed-aed6-534d76002e5f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:56 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d" returned: 0 in 0.492s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4_lprl3icpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:12:56 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 11:12:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:56 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f 1073741824 Sep 03 11:12:56 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:56 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d 1G Sep 03 11:12:56 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5230c12b-0284-496c-8bfe-5d25dea46796 tempest-CinderUnicodeTest-376686311 None] Create snapshot completed successfully Sep 03 11:12:57 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-4cdb74f0-5a28-4267-9d28-36006629ec7a" returned: 0 in 0.344s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-4cdb74f0-5a28-4267-9d28-36006629ec7a" released by "delete_volume" :: held 0.805s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Created reservations ['08d5fa7d-076b-4e12-bc59-64aa8008527b', '804f2b87-693a-4525-965e-d2889ca0a42e', 'b6808c1c-c6b6-4178-9606-12a836b0ae48', '21d5a839-7535-4020-9ea8-a406e29ef7aa'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:57 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d 1G" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Downloaded image c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4 ((None, [{'url': 'file:///opt/stack/data/glance/images/c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'metadata': {}}])) to volume 81d0969a-04df-4f7d-b17e-140bbf58023d successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:12:57 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:57 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Temporary image c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4 for user abcf6e368fc54af1a22e5418ac3e4512 is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Marking volume 81d0969a-04df-4f7d-b17e-140bbf58023d as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "cinder-91befffb-4292-4fea-ae2e-82ff6c736c26-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Copying metadata from image c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4 to 81d0969a-04df-4f7d-b17e-140bbf58023d. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Creating volume glance metadata for volume 81d0969a-04df-4f7d-b17e-140bbf58023d backed by image c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '664bd140aee6d7f9e0dd9efabd5a9381', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-91befffb-4292-4fea-ae2e-82ff6c736c26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "cinder-quobyte-6300224c-3d28-4db8-80c1-af9a13738e94" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-quobyte-6300224c-3d28-4db8-80c1-af9a13738e94" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "cinder-quobyte-91befffb-4292-4fea-ae2e-82ff6c736c26" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-quobyte-91befffb-4292-4fea-ae2e-82ff6c736c26" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Deleting offline snapshot 91befffb-4292-4fea-ae2e-82ff6c736c26 of volume 6300224c-3d28-4db8-80c1-af9a13738e94 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] snapshot_file for this snap is: volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:12:57 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f 1073741824" returned: 0 in 0.599s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c91ea6-c1a2-4779-938f-4b56800a9125]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3de3516-4baa-409c-94dc-5e58b4cf6d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d0969a-04df-4f7d-b17e-140bbf58023d', 'volume_size': 1, 'image_id': 'c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '664bd140aee6d7f9e0dd9efabd5a9381', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4157adb66cf04f4696d532cf846644f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25fc097cda487ea0b8eb7ec204478e34881b2f87a3bacb1ca12941395b1a0125bddc08564db1bd75bbe7b907d3bf4417061c3d9f2fd694c39458a9e6114adf8e', 'id': 'c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4', 'created_at': datetime.datetime(2026, 9, 3, 9, 12, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 12, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c167a7a7-aaf5-4d32-8cf6-b5c0f4193ad4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0028fdd7-1f88-43f3-b41a-92b5c523a0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:57 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f Sep 03 11:12:57 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "cinder-quobyte-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:57 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 Sep 03 11:12:57 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:57 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Volume volume-81d0969a-04df-4f7d-b17e-140bbf58023d (81d0969a-04df-4f7d-b17e-140bbf58023d): created successfully Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0028fdd7-1f88-43f3-b41a-92b5c523a0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Flow 'volume_create_manager' (4815700f-d257-4cde-9bec-36f6d80d4c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:57 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.390s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820" acquired by "delete_volume" :: waited 0.046s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Deleted volume successfully. Sep 03 11:12:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7b618bec-e651-452a-a235-08ed4740600a tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Created volume successfully. Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60f587f-fdee-4e21-99ee-dc5d047467f4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4fd19609-5c5a-43ff-abea-6d59315a3217 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-4cdb74f0-5a28-4267-9d28-36006629ec7a-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:57 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 Sep 03 11:12:57 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:57 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f" returned: 0 in 0.324s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.344s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497094362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c487a12-2fa7-4d12-a92c-5f4cf21e35c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:54Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Creating volume 1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:57 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:57 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26" returned: 0 in 0.461s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6300224c-3d28-4db8-80c1-af9a13738e94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:12:57 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 1073741824 Sep 03 11:12:57 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81b0519-a992-4a38-8c07-65361d7ef431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a12473-d92a-46ed-aed6-534d76002e5f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd49c5eb-c240-4671-a093-273b2dbca095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[724e637d-ccf7-4b7f-b69c-08f85fecd2ee]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:57 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume volume-d5a12473-d92a-46ed-aed6-534d76002e5f (d5a12473-d92a-46ed-aed6-534d76002e5f): created successfully Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd49c5eb-c240-4671-a093-273b2dbca095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (2506bcec-fc0e-4a4e-a384-d10dd5a15707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:58 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b0ef13a2-00d1-47e9-bb7a-2b0a31048dc4 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created volume successfully. Sep 03 11:12:58 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 Sep 03 11:12:58 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Acquiring lock "cinder-81d0969a-04df-4f7d-b17e-140bbf58023d-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "cinder-81d0969a-04df-4f7d-b17e-140bbf58023d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:58 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820" returned: 0 in 0.527s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:58 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820 Sep 03 11:12:58 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Acquiring lock "cinder-quobyte-81d0969a-04df-4f7d-b17e-140bbf58023d" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "cinder-quobyte-81d0969a-04df-4f7d-b17e-140bbf58023d" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad081f2-7744-419b-bfa6-db227e1f9b87]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:58 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94" returned: 0 in 0.480s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:58 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d Sep 03 11:12:58 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:58 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 Sep 03 11:12:58 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 1073741824" returned: 0 in 0.595s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:58 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:58 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820" returned: 0 in 0.306s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-quobyte-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820" released by "delete_volume" :: held 0.917s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:58 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 Sep 03 11:12:58 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Created reservations ['7d04391f-0e34-4871-81d9-38ec8c697f50', 'd011e840-eb64-47b3-ae3d-6a4d977a5344', '8c028a33-c0d2-4a1e-97fb-1e0e8a9255e4', 'ac18973e-b5bc-4026-81ee-3da88ca5384c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:58 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:58 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:58 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d" returned: 0 in 0.477s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:58 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d Sep 03 11:12:58 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:58 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0" returned: 0 in 0.328s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:58 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.742s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1964141183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac50bcb-100c-47cf-8d9c-208116b12830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:55Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Creating volume 0ac50bcb-100c-47cf-8d9c-208116b12830 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:58 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26" returned: 0 in 0.465s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:58 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830 1073741824 Sep 03 11:12:58 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:58 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26 Sep 03 11:12:58 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e038fc7-41fb-4850-aa4f-e5e7971bb9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca408e86-3864-44d8-857f-f34cd34bb3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:58 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 (1c487a12-2fa7-4d12-a92c-5f4cf21e35c0): created successfully Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca408e86-3864-44d8-857f-f34cd34bb3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (60153774-f677-44bd-a001-0852f31321cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:58 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-63ecbbc9-17cf-41a4-a26d-3b2e38227148 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created volume successfully. Sep 03 11:12:59 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.311s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Deleted volume successfully. Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-672fc7e2-4ca5-4a02-96ac-17c3afe8bf64 tempest-CreateVolumesFromImageTest-1188790893 None] Lock "cinder-6cfd1a53-72b8-4bbc-92fd-ea8f2b346820-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:59 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-81d0969a-04df-4f7d-b17e-140bbf58023d" returned: 0 in 0.341s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "cinder-quobyte-81d0969a-04df-4f7d-b17e-140bbf58023d" released by "delete_volume" :: held 0.857s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Created reservations ['926a8e9a-3943-403d-96b3-85ec3d23594d', '166b2532-3ff4-4d85-8ddb-4fb64708d881', 'ad2b36df-1f17-4c1c-a0be-c6b39f3f4772', '2a510d17-01f9-4c1c-8ce5-0570c236fa2a'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:59 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94.91befffb-4292-4fea-ae2e-82ff6c736c26" returned: 0 in 0.323s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-quobyte-91befffb-4292-4fea-ae2e-82ff6c736c26" released by "_delete_snapshot" :: held 1.904s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-quobyte-6300224c-3d28-4db8-80c1-af9a13738e94" released by "delete_snapshot" :: held 1.945s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:59 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:12:59 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Created reservations ['6fbdf1c2-0018-41e0-85bf-71f549251a44', 'af9843d4-ded4-4da0-aa4b-8b43bcdd459e', '5650089f-e2c3-4fb2-a26d-7b25ccb40b3f', '55e66326-6ab5-4a59-b467-234237d3fbb3'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:12:59 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830 1073741824" returned: 0 in 0.609s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Delete snapshot completed successfully. Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-aff9c202-cb64-45ba-937d-1c35a3914984 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-91befffb-4292-4fea-ae2e-82ff6c736c26-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:59 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830 Sep 03 11:12:59 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:59 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.283s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:12:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Deleted volume successfully. Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-36494cc1-2878-47f0-8814-fff2fa3d3f55 tempest-VolumeAndVolumeTypeFromImageTest-421252202 None] Lock "cinder-81d0969a-04df-4f7d-b17e-140bbf58023d-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:12:59 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830" returned: 0 in 0.299s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.136s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-965182558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c699b82-c2b7-4b3d-badf-7cd0c6eddac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:55Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Creating volume 2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:59 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d67397d-574d-4b0e-a0dc-6d4f55e9384b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac50bcb-100c-47cf-8d9c-208116b12830', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:59 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 1073741824 Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cd6008-f43d-4951-ae0b-4755708c0c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:59 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:59 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume volume-0ac50bcb-100c-47cf-8d9c-208116b12830 (0ac50bcb-100c-47cf-8d9c-208116b12830): created successfully Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cd6008-f43d-4951-ae0b-4755708c0c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:59 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (93e36b89-8c2d-413c-9201-ed122cd9334d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b74095fc-083c-43cd-911d-de117dae79a9 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created volume successfully. Sep 03 11:13:00 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 1073741824" returned: 0 in 0.583s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:00 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 Sep 03 11:13:00 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "cinder-6300224c-3d28-4db8-80c1-af9a13738e94-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-6300224c-3d28-4db8-80c1-af9a13738e94-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "cinder-quobyte-6300224c-3d28-4db8-80c1-af9a13738e94" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-quobyte-6300224c-3d28-4db8-80c1-af9a13738e94" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b7819f-3bd5-4ed9-9cb0-5ec18994f0af]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:00 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2" returned: 0 in 0.396s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.771s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1295622872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df7c5de-976e-4b44-b040-cde7d081eeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae5bdad01314f6ab4ca7e965d5d5f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:56Z,use_quota=True,user_id='f717747e5f5e4fd6996112b133f86e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Creating volume 7df7c5de-976e-4b44-b040-cde7d081eeeb {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:00 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 Sep 03 11:13:00 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:00 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:00 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb 1073741824 Sep 03 11:13:00 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2daf2a5-d27a-4408-bc25-69c7642706b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25287fc0-19cd-4790-9a9a-ce70831fd7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:00 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 (2c699b82-c2b7-4b3d-badf-7cd0c6eddac2): created successfully Sep 03 11:13:00 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25287fc0-19cd-4790-9a9a-ce70831fd7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (4ae2a2ec-76be-4d3f-99f4-d3efbc5b4834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c32c4cc9-ea62-4c98-9073-c64ff005d180 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created volume successfully. Sep 03 11:13:01 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94" returned: 0 in 0.559s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:01 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94 Sep 03 11:13:01 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:01 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb 1073741824" returned: 0 in 0.637s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:01 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb Sep 03 11:13:01 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:01 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6300224c-3d28-4db8-80c1-af9a13738e94" returned: 0 in 0.364s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-quobyte-6300224c-3d28-4db8-80c1-af9a13738e94" released by "delete_volume" :: held 1.031s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Created reservations ['a337d7f1-998e-41cb-92b6-8ed02232f1a9', '16f61d37-0512-4f2c-a66a-c3f2b60fa73c', '93cc9cd9-31a4-4098-acb9-3cf5903c4869', '0c8dac15-72a1-4225-8199-1a087169430d'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:01 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb" returned: 0 in 0.355s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:01 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:01 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a099f2dd-52b4-41ca-a589-375a4008702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df7c5de-976e-4b44-b040-cde7d081eeeb', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9556bc-0251-4636-97bd-05d9ffcda998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:01 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Volume volume-7df7c5de-976e-4b44-b040-cde7d081eeeb (7df7c5de-976e-4b44-b040-cde7d081eeeb): created successfully Sep 03 11:13:01 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9556bc-0251-4636-97bd-05d9ffcda998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Flow 'volume_create_manager' (44ba4a95-f47c-4ef8-8d81-e3ebd6b02373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1f72c106-2b8a-4c5a-8f01-fa198788bd26 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created volume successfully. Sep 03 11:13:02 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.313s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Deleted volume successfully. Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c416655a-654a-419f-826f-654dbda685c4 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-6300224c-3d28-4db8-80c1-af9a13738e94-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-7df7c5de-976e-4b44-b040-cde7d081eeeb-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-7df7c5de-976e-4b44-b040-cde7d081eeeb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-quobyte-7df7c5de-976e-4b44-b040-cde7d081eeeb" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "cinder-9917ce01-4255-46a9-9763-d34b3686cfa6-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-7df7c5de-976e-4b44-b040-cde7d081eeeb" acquired by "delete_volume" :: waited 0.033s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-9917ce01-4255-46a9-9763-d34b3686cfa6-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:02 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f22e6d7-27a3-443f-91c0-d976195e57d8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "cinder-quobyte-9917ce01-4255-46a9-9763-d34b3686cfa6" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-quobyte-9917ce01-4255-46a9-9763-d34b3686cfa6" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02bc819-a7a8-4939-82b5-88a8dc35a870]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:03 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb Sep 03 11:13:03 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:03 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6 Sep 03 11:13:03 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:03 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb" returned: 0 in 0.512s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:03 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb Sep 03 11:13:03 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:03 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6" returned: 0 in 0.490s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:03 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6 Sep 03 11:13:03 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:03 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7df7c5de-976e-4b44-b040-cde7d081eeeb" returned: 0 in 0.322s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-7df7c5de-976e-4b44-b040-cde7d081eeeb" released by "delete_volume" :: held 0.927s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:03 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created reservations ['7a71d787-5b47-4af9-adaf-682e0556c31f', 'd4f0aa9c-d6e7-49c3-8c54-1e8bf8605420', 'dc28b873-368f-4ed9-b29d-9365409c18dc', '6e11f5c1-bb60-4f13-af18-995bf438ff7e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:04 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9917ce01-4255-46a9-9763-d34b3686cfa6" returned: 0 in 0.407s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:04 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-quobyte-9917ce01-4255-46a9-9763-d34b3686cfa6" released by "delete_volume" :: held 0.987s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:04 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-quobyte-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Created reservations ['56d61c66-6d86-4152-975b-887c365de5de', '6bcfc24a-2000-4d61-b906-83339c84452c', 'ced1e87d-fce7-43fa-8283-59980a5b6f77', 'bfb11edd-9b20-47c6-a42c-6b7d0ca0e702'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b559c263-ba3c-4621-a9b9-c50b63a6d618]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:04 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:04 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:04 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 Sep 03 11:13:04 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:04 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.503s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Deleted volume successfully. Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-958c669a-e61e-4685-9bbe-58987e4a9732 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-7df7c5de-976e-4b44-b040-cde7d081eeeb-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:04 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.395s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Deleted volume successfully. Sep 03 11:13:04 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-7201c186-4ac7-4a31-95c3-b5ab3cf3cb84 tempest-CinderUnicodeTest-376686311 None] Lock "cinder-9917ce01-4255-46a9-9763-d34b3686cfa6-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2" returned: 0 in 0.505s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:04 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2 Sep 03 11:13:04 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:05 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2" returned: 0 in 0.354s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2" released by "delete_volume" :: held 0.910s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created reservations ['f2835872-bf15-45bc-b70f-5ad4a3d0957a', '0b0d8191-eecc-4ade-87e5-fb913ff10733', '5180e2a8-7a61-4f6b-9a72-8e7041a66a13', '20435832-d67e-45a8-9672-0dc09388066e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:05 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:05 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:05 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.273s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:05 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Deleted volume successfully. Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e5b2d24f-69ac-43dc-8514-1067f9761984 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-2c699b82-c2b7-4b3d-badf-7cd0c6eddac2-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-0ac50bcb-100c-47cf-8d9c-208116b12830-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-0ac50bcb-100c-47cf-8d9c-208116b12830-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-quobyte-0ac50bcb-100c-47cf-8d9c-208116b12830" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-0ac50bcb-100c-47cf-8d9c-208116b12830" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4035d14-dff5-4a1a-86ec-6c8bedcb3c18]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:05 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830 Sep 03 11:13:05 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:06 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830" returned: 0 in 0.426s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:06 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830 Sep 03 11:13:06 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:06 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ac50bcb-100c-47cf-8d9c-208116b12830" returned: 0 in 0.360s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-0ac50bcb-100c-47cf-8d9c-208116b12830" released by "delete_volume" :: held 0.838s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created reservations ['440ee8f9-f7c8-4ecb-88a7-a08acd5aee04', 'c0a44045-9883-419d-a1b8-c5013ffdce4b', '747319b5-10fa-4085-b1c4-2db81a60b1bd', 'f48d4999-ab3c-4ee6-b030-d8c7c2c398c8'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (5090820d-6144-4225-a51c-5b27ba1a991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1723947e-2a31-4967-bf22-17534816518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1723947e-2a31-4967-bf22-17534816518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828361068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a39309-eff8-4e07-89f2-aed0e1398d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:07Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aced6c3-6b18-429f-9d10-56db8bb88aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:06 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aced6c3-6b18-429f-9d10-56db8bb88aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:06 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5203e3bd-e3af-47fc-9b8a-92a8d4301fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5203e3bd-e3af-47fc-9b8a-92a8d4301fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a39309-eff8-4e07-89f2-aed0e1398d6d', 'volume_name': 'volume-36a39309-eff8-4e07-89f2-aed0e1398d6d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4685a7-6767-4684-ac1f-eb75f9e8f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:06 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4685a7-6767-4684-ac1f-eb75f9e8f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dda086b-418e-41fa-aa95-4a7a1da0a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:07 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Volume 36a39309-eff8-4e07-89f2-aed0e1398d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a39309-eff8-4e07-89f2-aed0e1398d6d', 'volume_size': 1} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828361068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a39309-eff8-4e07-89f2-aed0e1398d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:07Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Creating volume 36a39309-eff8-4e07-89f2-aed0e1398d6d {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:07 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:07 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d 1073741824 Sep 03 11:13:07 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-quobyte-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd23765-6d4f-42e2-99e0-533bced2d596]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:07 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.389s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:07 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Deleted volume successfully. Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-cf7fe404-0801-4221-be18-c813eff3cf9f tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-0ac50bcb-100c-47cf-8d9c-208116b12830-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:07 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 Sep 03 11:13:07 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:07 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d 1073741824" returned: 0 in 0.627s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:07 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:07 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0" returned: 0 in 0.545s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:07 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:07 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0 Sep 03 11:13:07 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Flow 'volume_create_manager' (b7d6dd87-820b-4df5-ab6a-1fba952949d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:07 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3633d71d-b4a0-475a-84f0-88659e918eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3633d71d-b4a0-475a-84f0-88659e918eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef40c5a-4b92-46f8-a4ef-7705ee36fef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0e6dc3ad3d4bf18dcf5c687ddedfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:08Z,use_quota=True,user_id='b41b4b44034b41db8d835b25c25b34db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0f8ca8-66cf-4bf0-b783-bf6161aa073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0f8ca8-66cf-4bf0-b783-bf6161aa073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae51036-d477-4f00-863c-860f02914df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.image.glance [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Creating Keystone auth plugin from conf {{(pid=86603) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d" returned: 0 in 0.337s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dda086b-418e-41fa-aa95-4a7a1da0a067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a39309-eff8-4e07-89f2-aed0e1398d6d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71de373-c162-412d-b389-01cf16455770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Volume volume-36a39309-eff8-4e07-89f2-aed0e1398d6d (36a39309-eff8-4e07-89f2-aed0e1398d6d): created successfully Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71de373-c162-412d-b389-01cf16455770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (5090820d-6144-4225-a51c-5b27ba1a991f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f58be25d-700c-47e5-aa6e-60330ab5518e tempest-ProjectMemberTests-1440316641 None] Created volume successfully. Sep 03 11:13:08 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0" returned: 0 in 0.439s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0" released by "delete_volume" :: held 1.060s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created reservations ['d4e6d163-4f21-434c-bdb4-4fae9ac46045', '662feba0-6d7e-4fe8-b70a-2f87980a8ed5', '3da7e428-935d-4c25-bb2b-144d0b7cf0ef', '305dd783-eee8-42af-8aa5-1a31d6898856'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:08 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:08 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae51036-d477-4f00-863c-860f02914df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ef40c5a-4b92-46f8-a4ef-7705ee36fef7', 'volume_name': 'volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7', 'volume_size': 1, 'image_id': '63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9e5f622ae197a01ab9184be75c24348', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e0e6dc3ad3d4bf18dcf5c687ddedfa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2807473890559646350ee3d42fe9c4016490a1a7f372d57350dc1da3fbab67ce9f117d2f1c556aea33a04f8d1566d441ce407c01c036e4f487466ff9b71ae47', 'id': '63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'created_at': datetime.datetime(2026, 9, 3, 9, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 13, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63ac1184-90e5-4367-a1a9-b1d3fe97a421/file', 'properties': {}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb4f8d9-8eca-43ff-808d-21ce6c558abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb4f8d9-8eca-43ff-808d-21ce6c558abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab619e7e-b2ec-4b5a-88d1-402d0a1f0eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Volume 8ef40c5a-4b92-46f8-a4ef-7705ee36fef7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7', 'volume_size': 1, 'image_id': '63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9e5f622ae197a01ab9184be75c24348', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e0e6dc3ad3d4bf18dcf5c687ddedfa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2807473890559646350ee3d42fe9c4016490a1a7f372d57350dc1da3fbab67ce9f117d2f1c556aea33a04f8d1566d441ce407c01c036e4f487466ff9b71ae47', 'id': '63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'created_at': datetime.datetime(2026, 9, 3, 9, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 13, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63ac1184-90e5-4367-a1a9-b1d3fe97a421/file', 'properties': {}}, 'image_service': } Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Trying to clone 8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 from image 63ac1184-90e5-4367-a1a9-b1d3fe97a421 at location (None, [{'url': 'file:///opt/stack/data/glance/images/63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'metadata': {}}]). {{(pid=86603) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:13:08 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.269s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Deleted volume successfully. Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:13:08 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Image download 0.00 MB at 0.00 MB/s Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e75ce82c-7389-49b6-88a1-4312e1d0155b tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-1c487a12-2fa7-4d12-a92c-5f4cf21e35c0-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc68b74e-b6ff-40ec-9cdf-bd132e143b4a]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:08 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD Sep 03 11:13:08 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:09 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:09 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD Sep 03 11:13:09 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-d5a12473-d92a-46ed-aed6-534d76002e5f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-d5a12473-d92a-46ed-aed6-534d76002e5f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-quobyte-d5a12473-d92a-46ed-aed6-534d76002e5f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-d5a12473-d92a-46ed-aed6-534d76002e5f" acquired by "delete_volume" :: waited 0.033s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:09 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Temporary image 63ac1184-90e5-4367-a1a9-b1d3fe97a421 is fetched for user b41b4b44034b41db8d835b25c25b34db. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fcf888-967b-4120-9295-c44f4a503bd3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Creating offline snapshot dcb259cf-ff41-4370-aa4d-120b5ce331cd of volume 36a39309-eff8-4e07-89f2-aed0e1398d6d {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[951e7aef-bbfc-409a-9fc7-807166a01616]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df7bde-8a36-444f-a2f4-16d776b1d9c3]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:09 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f Sep 03 11:13:09 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:09 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d Sep 03 11:13:09 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:09 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD Sep 03 11:13:09 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:09 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f" returned: 0 in 0.427s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:09 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f Sep 03 11:13:09 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:09 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:09 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d" returned: 0 in 0.480s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:10 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd 1G Sep 03 11:13:10 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:10 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD Sep 03 11:13:10 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:10 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d5a12473-d92a-46ed-aed6-534d76002e5f" returned: 0 in 0.327s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-d5a12473-d92a-46ed-aed6-534d76002e5f" released by "delete_volume" :: held 0.827s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created reservations ['e8a72422-5b42-48ce-81e9-138d3fa1b3eb', '622bbcb0-2878-4f0d-bc87-1df291de06cc', 'e0ee3691-bb1a-44ca-98ee-099d1c31529b', '26106df9-afda-4e99-88fa-6842c813b927'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:10 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:10 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:10 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-14561b6e-bf42-454a-9aff-e03387bdd340-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:10 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-14561b6e-bf42-454a-9aff-e03387bdd340-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-quobyte-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd 1G" returned: 0 in 0.547s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a39309-eff8-4e07-89f2-aed0e1398d6d -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-quobyte-14561b6e-bf42-454a-9aff-e03387bdd340" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:10 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a39309-eff8-4e07-89f2-aed0e1398d6d -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd Sep 03 11:13:10 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-14561b6e-bf42-454a-9aff-e03387bdd340" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Deleting offline snapshot 14561b6e-bf42-454a-9aff-e03387bdd340 of volume cfa71ba6-825c-4aba-a5c2-d61d529d96ad {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] snapshot_file for this snap is: volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eb372c-ae4a-463f-a37e-0612965ad2e3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:10 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 Sep 03 11:13:10 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:10 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.438s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Deleted volume successfully. Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a4f11d71-a32e-4e17-883a-22fe06674130 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-d5a12473-d92a-46ed-aed6-534d76002e5f-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:10 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a39309-eff8-4e07-89f2-aed0e1398d6d -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd" returned: 0 in 0.446s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:10 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd is being set with open permissions: ugo+rw Sep 03 11:13:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:11 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd Sep 03 11:13:11 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:11 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340" returned: 0 in 0.481s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f988a7c-f804-49d6-bfd1-5e625a4534df]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:11 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad Sep 03 11:13:11 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:11 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd" returned: 0 in 0.293s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:11 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.info Sep 03 11:13:11 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:11 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" returned: 0 in 0.428s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:11 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.info" returned: 0 in 0.279s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:11 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.info is being set with open permissions: ugo+rw Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:11 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 Sep 03 11:13:11 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:11 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.info Sep 03 11:13:11 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:11 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.info" returned: 0 in 0.304s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef40c5a-4b92-46f8-a4ef-7705ee36fef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0e6dc3ad3d4bf18dcf5c687ddedfa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:08Z,use_quota=True,user_id='b41b4b44034b41db8d835b25c25b34db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Creating volume 8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:11 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:11 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 1073741824 Sep 03 11:13:11 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3d99ed86-4489-4103-8d96-b343924a7d95 tempest-ProjectMemberTests-1440316641 None] Create snapshot completed successfully Sep 03 11:13:12 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340" returned: 0 in 0.456s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:12 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340 Sep 03 11:13:12 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:12 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad.14561b6e-bf42-454a-9aff-e03387bdd340" returned: 0 in 0.295s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-14561b6e-bf42-454a-9aff-e03387bdd340" released by "_delete_snapshot" :: held 1.791s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" released by "delete_snapshot" :: held 1.823s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created reservations ['34216c45-7b35-4721-94f2-9130e575f58f', 'c8d71484-e64d-4fe2-95e2-cc6448e4def0', '469346e2-2604-44e1-8166-92b4a859e702', 'b892237c-12f5-4555-81b0-5f25672f9806'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-dcb259cf-ff41-4370-aa4d-120b5ce331cd-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:12 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Delete snapshot completed successfully. Sep 03 11:13:12 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-dcb259cf-ff41-4370-aa4d-120b5ce331cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-36a39309-eff8-4e07-89f2-aed0e1398d6d" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a0ff3459-1f44-4d79-8316-66d8c4187adf tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-14561b6e-bf42-454a-9aff-e03387bdd340-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 1073741824" returned: 0 in 0.653s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-36a39309-eff8-4e07-89f2-aed0e1398d6d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-dcb259cf-ff41-4370-aa4d-120b5ce331cd" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-dcb259cf-ff41-4370-aa4d-120b5ce331cd" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Deleting offline snapshot dcb259cf-ff41-4370-aa4d-120b5ce331cd of volume 36a39309-eff8-4e07-89f2-aed0e1398d6d {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:13:12 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 Sep 03 11:13:12 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] snapshot_file for this snap is: volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e00cae7-93fd-4fc8-834c-7d633248285d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-cfa71ba6-825c-4aba-a5c2-d61d529d96ad-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-cfa71ba6-825c-4aba-a5c2-d61d529d96ad-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "cinder-quobyte-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:12 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd Sep 03 11:13:12 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fe3dcd-459e-4fc5-808c-a5e899065fef]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:12 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7" returned: 0 in 0.319s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:12 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Attempting download of 63ac1184-90e5-4367-a1a9-b1d3fe97a421 ((None, [{'url': 'file:///opt/stack/data/glance/images/63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'metadata': {}}])) to volume 8ef40c5a-4b92-46f8-a4ef-7705ee36fef7. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:13:13 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad Sep 03 11:13:13 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[addaa733-5ec2-4407-bbf0-055c277ba640]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63ac1184-90e5-4367-a1a9-b1d3fe97a421_fivgalzq {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:13 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd" returned: 0 in 0.522s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a39309-eff8-4e07-89f2-aed0e1398d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[95af1e10-cf02-4f76-b25b-1f36f54c2207]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:13 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63ac1184-90e5-4367-a1a9-b1d3fe97a421_fivgalzq Sep 03 11:13:13 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:13 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" returned: 0 in 0.466s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:13 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d Sep 03 11:13:13 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:13 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad Sep 03 11:13:13 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:13 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63ac1184-90e5-4367-a1a9-b1d3fe97a421_fivgalzq" returned: 0 in 0.462s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ac1184-90e5-4367-a1a9-b1d3fe97a421_fivgalzq {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:13 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ac1184-90e5-4367-a1a9-b1d3fe97a421_fivgalzq Sep 03 11:13:13 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:13 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:13 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d" returned: 0 in 0.444s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" returned: 0 in 0.342s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:13 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd Sep 03 11:13:13 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-quobyte-cfa71ba6-825c-4aba-a5c2-d61d529d96ad" released by "delete_volume" :: held 0.904s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Created reservations ['3a5b5584-447b-40cd-a1f7-1785ccbcb219', '4e3fa57f-4962-4811-ae83-e95eb1486f93', 'c77bcd96-10dc-4584-ae58-886a2db1fa24', '825f9ec2-9fb6-4be2-aa0f-783251799dbc'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:13 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ac1184-90e5-4367-a1a9-b1d3fe97a421_fivgalzq" returned: 1 in 0.409s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63ac1184-90e5-4367-a1a9-b1d3fe97a421_fivgalzq' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f3502b-cf62-4152-a8ad-f6b74f6bfdee]: (4, 'raw') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:13 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:13 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:14 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD Sep 03 11:13:14 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:14 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd" returned: 0 in 0.536s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:14 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd Sep 03 11:13:14 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:14 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.441s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Deleted volume successfully. Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-421672ec-63ca-401b-b9e3-4ee355e64dc3 tempest-CreateVolumesFromSnapshotTest-1368763954 None] Lock "cinder-cfa71ba6-825c-4aba-a5c2-d61d529d96ad-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:14 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:14 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD Sep 03 11:13:14 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:14 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d.dcb259cf-ff41-4370-aa4d-120b5ce331cd" returned: 0 in 0.391s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-dcb259cf-ff41-4370-aa4d-120b5ce331cd" released by "_delete_snapshot" :: held 2.057s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-36a39309-eff8-4e07-89f2-aed0e1398d6d" released by "delete_snapshot" :: held 2.106s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Created reservations ['3e4369e9-1ded-4588-a2e2-121b3361c997', '7dcb7ea8-90ab-40f4-8246-b4b4f9e758c1', 'fb7624d8-aa53-44ee-a31d-37fd7e1727d1', '5f6da10b-793e-4e51-927e-05143e2aba4f'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:14 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] 63ac1184-90e5-4367-a1a9-b1d3fe97a421 was raw, converting to qcow2 {{(pid=86603) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:14 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Delete snapshot completed successfully. Sep 03 11:13:14 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 Sep 03 11:13:14 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:14 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d94bda18-9029-4ad2-a86e-8a5ef98b648a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-dcb259cf-ff41-4370-aa4d-120b5ce331cd-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:15 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7" returned: 0 in 0.579s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63ac1184-90e5-4367-a1a9-b1d3fe97a421_0ggtv2hndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:13:15 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:15 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 1G Sep 03 11:13:15 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-36a39309-eff8-4e07-89f2-aed0e1398d6d-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:15 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 1G" returned: 0 in 0.364s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Downloaded image 63ac1184-90e5-4367-a1a9-b1d3fe97a421 ((None, [{'url': 'file:///opt/stack/data/glance/images/63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'metadata': {}}])) to volume 8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 successfully. {{(pid=86603) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Temporary image 63ac1184-90e5-4367-a1a9-b1d3fe97a421 for user b41b4b44034b41db8d835b25c25b34db is deleted. {{(pid=86603) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.volume.volume_utils [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Marking volume 8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 as bootable. {{(pid=86603) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-36a39309-eff8-4e07-89f2-aed0e1398d6d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Copying metadata from image 63ac1184-90e5-4367-a1a9-b1d3fe97a421 to 8ef40c5a-4b92-46f8-a4ef-7705ee36fef7. {{(pid=86603) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Creating volume glance metadata for volume 8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 backed by image 63ac1184-90e5-4367-a1a9-b1d3fe97a421 with: {'image_id': '63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f9e5f622ae197a01ab9184be75c24348', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86603) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-36a39309-eff8-4e07-89f2-aed0e1398d6d" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-36a39309-eff8-4e07-89f2-aed0e1398d6d" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3837a2b6-604a-48f6-af02-6de3d75ff8dc]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab619e7e-b2ec-4b5a-88d1-402d0a1f0eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7', 'volume_size': 1, 'image_id': '63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9e5f622ae197a01ab9184be75c24348', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e0e6dc3ad3d4bf18dcf5c687ddedfa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2807473890559646350ee3d42fe9c4016490a1a7f372d57350dc1da3fbab67ce9f117d2f1c556aea33a04f8d1566d441ce407c01c036e4f487466ff9b71ae47', 'id': '63ac1184-90e5-4367-a1a9-b1d3fe97a421', 'created_at': datetime.datetime(2026, 9, 3, 9, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 13, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63ac1184-90e5-4367-a1a9-b1d3fe97a421/file', 'properties': {}}, 'image_service': }' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d44f95-4b3e-4d70-a091-d86e93c23686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:16 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Volume volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 (8ef40c5a-4b92-46f8-a4ef-7705ee36fef7): created successfully Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d44f95-4b3e-4d70-a091-d86e93c23686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Flow 'volume_create_manager' (b7d6dd87-820b-4df5-ab6a-1fba952949d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d6835305-55f0-4737-968e-c7193641e91f tempest-VolumeImageDependencyTests-520638011 None] Created volume successfully. Sep 03 11:13:16 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d Sep 03 11:13:16 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:16 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d" returned: 0 in 0.409s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:16 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d Sep 03 11:13:16 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Acquiring lock "cinder-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Lock "cinder-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Acquiring lock "cinder-quobyte-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Lock "cinder-quobyte-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:16 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-36a39309-eff8-4e07-89f2-aed0e1398d6d" returned: 0 in 0.383s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[956b92a0-1222-4633-85c5-2ed373eb5266]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-36a39309-eff8-4e07-89f2-aed0e1398d6d" released by "delete_volume" :: held 0.880s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Created reservations ['6c59a6b2-a11e-4058-b6ea-fbb54c01bc5a', '2411b3a1-5707-4567-8cd0-253725a6008d', 'dc934a13-ee46-4c26-acde-6bd17149f3ac', '3afda2c0-a324-411f-a043-85380d238d7a'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:16 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 Sep 03 11:13:16 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:17 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:17 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:17 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7" returned: 0 in 0.514s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:17 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7 Sep 03 11:13:17 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:17 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.448s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:17 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Deleted volume successfully. Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4cd06cd0-1f2c-45a6-8851-7b0c735f6149 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-36a39309-eff8-4e07-89f2-aed0e1398d6d-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:17 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7" returned: 0 in 0.368s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Lock "cinder-quobyte-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7" released by "delete_volume" :: held 0.948s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Created reservations ['43a1ac83-a1bb-44c3-b426-aa632f642a34', 'dee0d10e-c631-4d9a-bb84-068e95f38293', 'b905ec7e-f136-4a1d-8990-f5ca1da5a920', '02e5f3cf-887b-4785-ba1e-2c7aacd371fa'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:17 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:17 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (9c52b049-d905-4ae6-83d6-26e11adbab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d7fcf3-b31f-4f6e-bf01-36b46bcb1bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d7fcf3-b31f-4f6e-bf01-36b46bcb1bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211575375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340beac7-ba0f-4efa-99b2-c0bc33647fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:18Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6930bbbd-9faf-4048-89a1-d046dd19aeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6930bbbd-9faf-4048-89a1-d046dd19aeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288adf6d-cc97-487d-9147-a6f2486a345f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288adf6d-cc97-487d-9147-a6f2486a345f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340beac7-ba0f-4efa-99b2-c0bc33647fb4', 'volume_name': 'volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf0587b-9ed5-4228-86d3-99fe6a721c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf0587b-9ed5-4228-86d3-99fe6a721c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9910d9b0-91ee-4e02-b6e7-805114a8f8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:17 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume 340beac7-ba0f-4efa-99b2-c0bc33647fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4', 'volume_size': 1} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211575375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340beac7-ba0f-4efa-99b2-c0bc33647fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:18Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Creating volume 340beac7-ba0f-4efa-99b2-c0bc33647fb4 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:17 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:18 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 1073741824 Sep 03 11:13:18 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:18 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (9c459ddf-fccc-46df-807e-f859f87f1a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed1c34a-f55f-47af-bd2b-278d37887ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.288s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Deleted volume successfully. Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed1c34a-f55f-47af-bd2b-278d37887ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524764727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98658e0-baf2-4d7a-ad0e-c454a7b30a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:18Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af47531-e99f-416d-969d-766d2a1ebcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af47531-e99f-416d-969d-766d2a1ebcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42f3606-171b-4b17-aa1a-89a176640628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42f3606-171b-4b17-aa1a-89a176640628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd98658e0-baf2-4d7a-ad0e-c454a7b30a9e', 'volume_name': 'volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71996b14-eedd-4b95-a704-f02db4bca8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71996b14-eedd-4b95-a704-f02db4bca8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882de4ec-14ea-4fe6-b996-2fd693c18ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:18 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Volume d98658e0-baf2-4d7a-ad0e-c454a7b30a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e', 'volume_size': 1} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6a6b6c0d-8cea-4fb8-944b-5a37adaebd18 tempest-VolumeImageDependencyTests-520638011 None] Lock "cinder-8ef40c5a-4b92-46f8-a4ef-7705ee36fef7-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:18 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 1073741824" returned: 0 in 0.494s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:18 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 Sep 03 11:13:18 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:18 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4" returned: 0 in 0.287s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524764727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98658e0-baf2-4d7a-ad0e-c454a7b30a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:18Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Creating volume d98658e0-baf2-4d7a-ad0e-c454a7b30a9e {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:18 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9910d9b0-91ee-4e02-b6e7-805114a8f8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27836b6-6365-4713-a99a-a6718efd6eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:18 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e 1073741824 Sep 03 11:13:18 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:18 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 (340beac7-ba0f-4efa-99b2-c0bc33647fb4): created successfully Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27836b6-6365-4713-a99a-a6718efd6eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:18 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (9c52b049-d905-4ae6-83d6-26e11adbab9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d478486a-f1a0-4526-ae0b-b327e2d6cb7f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created volume successfully. Sep 03 11:13:19 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e 1073741824" returned: 0 in 0.531s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:19 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e Sep 03 11:13:19 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:19 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" returned: 0 in 0.261s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882de4ec-14ea-4fe6-b996-2fd693c18ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06dab1c-dbef-427f-b0a9-911b8143090d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:19 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Volume volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e (d98658e0-baf2-4d7a-ad0e-c454a7b30a9e): created successfully Sep 03 11:13:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06dab1c-dbef-427f-b0a9-911b8143090d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (9c459ddf-fccc-46df-807e-f859f87f1a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:19 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e42f607a-e7b1-4bfd-b483-cad8d915e865 tempest-ProjectMemberTests-1440316641 None] Created volume successfully. Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Creating offline snapshot 2218c3c8-3d34-4187-8d78-84c15312d8f8 of volume d98658e0-baf2-4d7a-ad0e-c454a7b30a9e {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd885b-f5bb-4a43-ad43-a1791acbbd68]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:20 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e Sep 03 11:13:20 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (7630d719-2e17-482d-8b24-c22cd22abe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e29c3c-a7ea-446a-ac69-fddcca454ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e29c3c-a7ea-446a-ac69-fddcca454ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-728835948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d4f7b0-eaf0-41e8-a906-0301b995e65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:21Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf058716-1a9c-4955-b280-acd5342edfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf058716-1a9c-4955-b280-acd5342edfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcc089a-ab10-4e02-8b89-e255f0fb7f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcc089a-ab10-4e02-8b89-e255f0fb7f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d4f7b0-eaf0-41e8-a906-0301b995e65f', 'volume_name': 'volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4496160-8ba6-451a-9b6c-0760a2962b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4496160-8ba6-451a-9b6c-0760a2962b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dacbc6b-c26a-469b-87d0-e6085166b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:20 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume 37d4f7b0-eaf0-41e8-a906-0301b995e65f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f', 'volume_size': 1} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:20 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" returned: 0 in 0.511s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:20 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 1G Sep 03 11:13:20 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (684a09b2-db9f-4fa0-a6d4-f9dfac7695d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec87a3a-c400-446c-a563-498ccd438f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec87a3a-c400-446c-a563-498ccd438f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411885320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809e319c-c2ab-4721-937b-0d8ea2c60f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:21Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41316116-b157-4887-b0b3-dad57ac7b7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41316116-b157-4887-b0b3-dad57ac7b7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41476df3-54e2-4407-bfb7-429a750284db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41476df3-54e2-4407-bfb7-429a750284db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809e319c-c2ab-4721-937b-0d8ea2c60f06', 'volume_name': 'volume-809e319c-c2ab-4721-937b-0d8ea2c60f06', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddde08f2-aa47-471a-b1b5-aee920581692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddde08f2-aa47-471a-b1b5-aee920581692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ec58b6-76f8-4259-8e79-7abfb50adee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume 809e319c-c2ab-4721-937b-0d8ea2c60f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809e319c-c2ab-4721-937b-0d8ea2c60f06', 'volume_size': 1} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:21 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 1G" returned: 0 in 0.729s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:21 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 Sep 03 11:13:21 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (e0a82b48-f88f-45a4-a98c-1d36855432ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09970ec-9e4e-4a62-bb4a-f68e27a2962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09970ec-9e4e-4a62-bb4a-f68e27a2962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774150957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9104d9b-ceea-442c-8a15-9c6c046a0a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:22Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea1b673-e259-47ad-b036-f255952daaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea1b673-e259-47ad-b036-f255952daaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80679ce1-f9b7-4bc7-bacf-cc5e08fdc835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80679ce1-f9b7-4bc7-bacf-cc5e08fdc835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9104d9b-ceea-442c-8a15-9c6c046a0a6a', 'volume_name': 'volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ec373d-fd51-4ff6-87f7-4f56f378657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ec373d-fd51-4ff6-87f7-4f56f378657b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dd4744-4ca3-4a03-aefb-cccc64c14277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:21 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume c9104d9b-ceea-442c-8a15-9c6c046a0a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a', 'volume_size': 1} Sep 03 11:13:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:22 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8" returned: 0 in 0.392s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:22 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 is being set with open permissions: ugo+rw Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:22 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 Sep 03 11:13:22 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:22 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8" returned: 0 in 0.343s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:22 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.info Sep 03 11:13:22 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (38ac5f14-0406-4c4c-b550-3b8ff4e00736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96219366-163a-4e9c-85bc-1fce121fa839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96219366-163a-4e9c-85bc-1fce121fa839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-12538671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52eeeb7-d120-443b-9581-5c5ba963ba12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:22Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755bf8d1-e0cd-4597-bdf8-b7dea451fd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755bf8d1-e0cd-4597-bdf8-b7dea451fd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6546870-c603-4493-b651-5d63f1861c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6546870-c603-4493-b651-5d63f1861c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a52eeeb7-d120-443b-9581-5c5ba963ba12', 'volume_name': 'volume-a52eeeb7-d120-443b-9581-5c5ba963ba12', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3704c00e-c202-4197-a2f6-394dce3ca9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3704c00e-c202-4197-a2f6-394dce3ca9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f048a5-1f54-4e69-aacb-387cd7711621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume a52eeeb7-d120-443b-9581-5c5ba963ba12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a52eeeb7-d120-443b-9581-5c5ba963ba12', 'volume_size': 1} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:22 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.info" returned: 0 in 0.442s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:22 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.info is being set with open permissions: ugo+rw Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:22 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.info Sep 03 11:13:22 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (40941dfa-dfb4-4e25-a9e8-c8fdd3f6b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:22 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76473371-114f-498d-a2df-8580bb4b6fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76473371-114f-498d-a2df-8580bb4b6fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603373205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:23Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e20f79-3f5c-4856-814e-17533e57e984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e20f79-3f5c-4856-814e-17533e57e984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05b72db-dadb-400f-a21b-765f6d74962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05b72db-dadb-400f-a21b-765f6d74962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d', 'volume_name': 'volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6980005e-d4a1-4e56-9455-b8d00f91d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6980005e-d4a1-4e56-9455-b8d00f91d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe208212-dace-43ee-8f93-871744eec33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:23 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume 6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d', 'volume_size': 1} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:23 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.info" returned: 0 in 0.355s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.958s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.473s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-728835948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d4f7b0-eaf0-41e8-a906-0301b995e65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:21Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Creating volume 37d4f7b0-eaf0-41e8-a906-0301b995e65f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:23 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:23 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f 1073741824 Sep 03 11:13:23 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:23 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3f183e68-f799-459d-b337-1c12a1c2b07d tempest-ProjectMemberTests-1440316641 None] Create snapshot completed successfully Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:23 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:23 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-2218c3c8-3d34-4187-8d78-84c15312d8f8-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-2218c3c8-3d34-4187-8d78-84c15312d8f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-2218c3c8-3d34-4187-8d78-84c15312d8f8" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-2218c3c8-3d34-4187-8d78-84c15312d8f8" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Deleting offline snapshot 2218c3c8-3d34-4187-8d78-84c15312d8f8 of volume d98658e0-baf2-4d7a-ad0e-c454a7b30a9e {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] snapshot_file for this snap is: volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[491d9a26-8a3b-4d56-9d2a-7afbfa433483]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-54fb6061-b4d1-42ce-81ff-d6ae2f6c8229 tempest-ProjectAdminTests-1640754119 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8575019836426, 'free_capacity_gb': 1773.8575019836426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86603) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 11:13:23 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 Sep 03 11:13:23 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:23 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.400s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:23 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f 1073741824" returned: 0 in 0.646s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:13:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:23 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f Sep 03 11:13:23 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:24 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8" returned: 0 in 0.498s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d592fdf-22e7-47fd-bcab-22d840230102]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:24 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f" returned: 0 in 0.319s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.802s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411885320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809e319c-c2ab-4721-937b-0d8ea2c60f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:21Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Creating volume 809e319c-c2ab-4721-937b-0d8ea2c60f06 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:24 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dacbc6b-c26a-469b-87d0-e6085166b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8524341e-e326-469c-87ee-aff12c76a828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:24 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f (37d4f7b0-eaf0-41e8-a906-0301b995e65f): created successfully Sep 03 11:13:24 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 1073741824 Sep 03 11:13:24 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8524341e-e326-469c-87ee-aff12c76a828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:24 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e Sep 03 11:13:24 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (7630d719-2e17-482d-8b24-c22cd22abe31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:24 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-23d21e49-970e-465c-9469-f3cb72b55178 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created volume successfully. Sep 03 11:13:24 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" returned: 0 in 0.466s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:24 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 Sep 03 11:13:24 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:24 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 1073741824" returned: 0 in 0.531s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:24 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 Sep 03 11:13:24 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:25 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8" returned: 0 in 0.495s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:25 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06" returned: 0 in 0.372s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:25 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8 Sep 03 11:13:25 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.261s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774150957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9104d9b-ceea-442c-8a15-9c6c046a0a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:22Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Creating volume c9104d9b-ceea-442c-8a15-9c6c046a0a6a {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:25 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ec58b6-76f8-4259-8e79-7abfb50adee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809e319c-c2ab-4721-937b-0d8ea2c60f06', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:25 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a 1073741824 Sep 03 11:13:25 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a94531e-899f-497e-9968-05c65cd554e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:25 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 (809e319c-c2ab-4721-937b-0d8ea2c60f06): created successfully Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a94531e-899f-497e-9968-05c65cd554e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (684a09b2-db9f-4fa0-a6d4-f9dfac7695d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5b4e8ec7-9df7-4369-9735-9112c42a6209 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created volume successfully. Sep 03 11:13:25 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e.2218c3c8-3d34-4187-8d78-84c15312d8f8" returned: 0 in 0.363s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-2218c3c8-3d34-4187-8d78-84c15312d8f8" released by "_delete_snapshot" :: held 1.962s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" released by "delete_snapshot" :: held 2.005s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Created reservations ['a2655af8-4187-430b-9ae5-83823e322af0', '21e16967-d15d-48e5-9cb7-d3b080f56f44', '5d4a82b9-314a-4a5d-8c6c-56debc6a42de', '21061beb-573a-4622-b5ae-323d2d21d7aa'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Delete snapshot completed successfully. Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9e6d1b0-f285-4da2-ac1b-b6ed2aa49a82 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-2218c3c8-3d34-4187-8d78-84c15312d8f8-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:25 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a 1073741824" returned: 0 in 0.639s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:25 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a Sep 03 11:13:25 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:26 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a" returned: 0 in 0.309s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.441s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-12538671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52eeeb7-d120-443b-9581-5c5ba963ba12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:22Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Creating volume a52eeeb7-d120-443b-9581-5c5ba963ba12 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:26 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:26 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 1073741824 Sep 03 11:13:26 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dd4744-4ca3-4a03-aefb-cccc64c14277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1d76e8-173d-47c3-b707-d8f98e5dd31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:26 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a (c9104d9b-ceea-442c-8a15-9c6c046a0a6a): created successfully Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1d76e8-173d-47c3-b707-d8f98e5dd31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (e0a82b48-f88f-45a4-a98c-1d36855432ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:26 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8c375bf6-d26c-4ce0-819c-1e9cc450c191 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created volume successfully. Sep 03 11:13:26 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 1073741824" returned: 0 in 0.565s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:26 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 Sep 03 11:13:26 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[511bd6a2-af7a-495a-b941-dfe5a6d929f2]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:27 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e Sep 03 11:13:27 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:27 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12" returned: 0 in 0.284s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.205s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603373205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88887effcd1417f8b9698cf9d34e6f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:23Z,use_quota=True,user_id='de915fb5c679471abe3671359dfebd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Creating volume 6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:27 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f048a5-1f54-4e69-aacb-387cd7711621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52eeeb7-d120-443b-9581-5c5ba963ba12', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f4f03d-2845-4d80-be2d-3ce20b8633e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:27 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d 1073741824 Sep 03 11:13:27 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:27 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 (a52eeeb7-d120-443b-9581-5c5ba963ba12): created successfully Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f4f03d-2845-4d80-be2d-3ce20b8633e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (38ac5f14-0406-4c4c-b550-3b8ff4e00736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:27 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0e29757d-280c-4449-8f50-d3af2165f723 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created volume successfully. Sep 03 11:13:27 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" returned: 0 in 0.445s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:27 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e Sep 03 11:13:27 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:27 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" returned: 0 in 0.321s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e" released by "delete_volume" :: held 0.836s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:27 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d 1073741824" returned: 0 in 0.646s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:27 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d Sep 03 11:13:27 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Created reservations ['8d3bcaf6-bcf7-46e8-815b-a9deda9fe59a', 'e59f5c69-6d56-43c5-931f-c103876b023e', '65b5e4e6-d1de-422c-90a6-dc9701e556cc', '27f55e9b-5d57-4f68-b43e-15194338635c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:27 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:28 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:28 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:28 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d" returned: 0 in 0.503s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:28 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe208212-dace-43ee-8f93-871744eec33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63aa65f0-23b0-4c22-bc8f-a93c98e1261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.401s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:28 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Volume volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d (6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d): created successfully Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63aa65f0-23b0-4c22-bc8f-a93c98e1261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Flow 'volume_create_manager' (40941dfa-dfb4-4e25-a9e8-c8fdd3f6b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:28 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Deleted volume successfully. Sep 03 11:13:28 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6f40c698-ff40-49cc-85b3-637128a1612b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created volume successfully. Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-49773b58-22a5-4908-91e0-76d0b2fdf061 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-d98658e0-baf2-4d7a-ad0e-c454a7b30a9e-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (6c537f32-3e91-4fd5-abcf-804376573305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c1a434-7ef2-4edd-b7d0-2d30f358091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c1a434-7ef2-4edd-b7d0-2d30f358091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035644617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e014f792-390d-4d7b-b0e1-a76ea15db7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:29Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d579e863-93aa-447b-a3d0-88c0244a40db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d579e863-93aa-447b-a3d0-88c0244a40db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b90409-73b5-4d95-b37d-78889929e70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b90409-73b5-4d95-b37d-78889929e70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e014f792-390d-4d7b-b0e1-a76ea15db7e0', 'volume_name': 'volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5177c2e4-508a-4ed1-b3e4-b27140d3b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:28 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5177c2e4-508a-4ed1-b3e4-b27140d3b823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1529361-5cd6-4e52-b598-77c775794b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:29 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Volume e014f792-390d-4d7b-b0e1-a76ea15db7e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0', 'volume_size': 1} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035644617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e014f792-390d-4d7b-b0e1-a76ea15db7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:29Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Creating volume e014f792-390d-4d7b-b0e1-a76ea15db7e0 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:29 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:29 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 1073741824 Sep 03 11:13:29 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-quobyte-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[4347121f-f80e-48ce-938d-eda5161975ef]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:29 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d Sep 03 11:13:29 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:29 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d" returned: 0 in 0.415s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:29 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d Sep 03 11:13:29 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:29 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 1073741824" returned: 0 in 0.602s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:29 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 Sep 03 11:13:29 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:29 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d" returned: 0 in 0.322s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d" released by "delete_volume" :: held 0.794s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:29 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created reservations ['ccb018c2-eb89-48f5-b9f5-e46a75ded1ba', '63339273-ca9d-4f6b-9809-cac44ce2e313', '86b8787a-08a7-45b8-b763-a3a5130c13cd', 'c4614e58-0162-4155-9cf0-8813e4962b0c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:30 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0" returned: 0 in 0.354s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1529361-5cd6-4e52-b598-77c775794b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70893472-8839-4cbc-a406-35752a6370ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-a52eeeb7-d120-443b-9581-5c5ba963ba12-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:30 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:30 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Volume volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 (e014f792-390d-4d7b-b0e1-a76ea15db7e0): created successfully Sep 03 11:13:30 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70893472-8839-4cbc-a406-35752a6370ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (6c537f32-3e91-4fd5-abcf-804376573305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-a52eeeb7-d120-443b-9581-5c5ba963ba12-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:30 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-58cdf27a-1eb6-4872-8248-8136846566a2 tempest-ProjectMemberTests-1440316641 None] Created volume successfully. Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-quobyte-a52eeeb7-d120-443b-9581-5c5ba963ba12" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-a52eeeb7-d120-443b-9581-5c5ba963ba12" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fb1eeb-0117-48dd-8afd-00f995ef5fd8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:30 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.359s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:30 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Deleted volume successfully. Sep 03 11:13:30 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 Sep 03 11:13:30 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d392cfd1-1f1a-494f-be6e-762eaa7f2da2 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-6fcd54e7-f7d8-463e-8dc1-eae20c0eae0d-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:30 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12" returned: 0 in 0.468s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:30 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12 Sep 03 11:13:30 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Creating offline snapshot c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 of volume e014f792-390d-4d7b-b0e1-a76ea15db7e0 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:13:31 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[613711b8-7247-4fdc-b032-1ca3c2eb9d2d]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-a52eeeb7-d120-443b-9581-5c5ba963ba12" returned: 0 in 0.417s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-a52eeeb7-d120-443b-9581-5c5ba963ba12" released by "delete_volume" :: held 0.957s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created reservations ['104e458f-ef2a-4afb-8213-7a119b59c992', 'c0ec66f5-5760-4d04-9dcd-26d142508a2d', '2cd8294d-4754-400a-8015-154fe70e2816', '18c0588f-5057-4766-9107-0fcde95004dc'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:31 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 Sep 03 11:13:31 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:31 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:31 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:31 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0" returned: 0 in 0.531s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:31 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.357s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:31 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 1G Sep 03 11:13:31 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Deleted volume successfully. Sep 03 11:13:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-d264a998-8b57-4db8-95f0-7352bf7c445f tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-a52eeeb7-d120-443b-9581-5c5ba963ba12-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:32 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 1G" returned: 0 in 0.557s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:32 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 Sep 03 11:13:32 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-c9104d9b-ceea-442c-8a15-9c6c046a0a6a-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-c9104d9b-ceea-442c-8a15-9c6c046a0a6a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-quobyte-c9104d9b-ceea-442c-8a15-9c6c046a0a6a" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-c9104d9b-ceea-442c-8a15-9c6c046a0a6a" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4983794-b003-4734-af45-49741c5e3751]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:32 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20" returned: 0 in 0.387s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:32 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 is being set with open permissions: ugo+rw Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:32 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 Sep 03 11:13:32 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:32 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a Sep 03 11:13:32 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:32 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20" returned: 0 in 0.278s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:33 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.info Sep 03 11:13:33 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:33 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a" returned: 0 in 0.425s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:33 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a Sep 03 11:13:33 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:33 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.info" returned: 0 in 0.322s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:33 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.info is being set with open permissions: ugo+rw Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:33 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.info Sep 03 11:13:33 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:33 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-c9104d9b-ceea-442c-8a15-9c6c046a0a6a" returned: 0 in 0.312s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-c9104d9b-ceea-442c-8a15-9c6c046a0a6a" released by "delete_volume" :: held 0.809s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created reservations ['d07d8fd5-1f21-49cf-894e-49fcf1e516eb', '99210aa5-df7b-47b8-93d8-bd2c874cb6df', '99a68c3d-d99e-4247-8a13-36d1f3c95e81', '65915231-9cef-45c3-aa51-85650132a439'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:33 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:33 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:33 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.info" returned: 0 in 0.330s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-809e319c-c2ab-4721-937b-0d8ea2c60f06-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-809e319c-c2ab-4721-937b-0d8ea2c60f06-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:33 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-cea970ea-70eb-4064-b0b8-3f8d21b3f9a0 tempest-ProjectMemberTests-1440316641 None] Create snapshot completed successfully Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-quobyte-809e319c-c2ab-4721-937b-0d8ea2c60f06" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-809e319c-c2ab-4721-937b-0d8ea2c60f06" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d39c22f-173f-47fc-b64f-ea089aade127]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:33 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.378s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:33 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Deleted volume successfully. Sep 03 11:13:33 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3e38cb3a-ecb7-4d5d-bb03-3ce3253e55a4 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-c9104d9b-ceea-442c-8a15-9c6c046a0a6a-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:33 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 Sep 03 11:13:33 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:34 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06" returned: 0 in 0.441s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:34 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06 Sep 03 11:13:34 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-e014f792-390d-4d7b-b0e1-a76ea15db7e0" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-e014f792-390d-4d7b-b0e1-a76ea15db7e0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Deleting offline snapshot c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 of volume e014f792-390d-4d7b-b0e1-a76ea15db7e0 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] snapshot_file for this snap is: volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c7c710-e8f9-4349-a637-13476b88a0f1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:34 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-809e319c-c2ab-4721-937b-0d8ea2c60f06" returned: 0 in 0.342s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-809e319c-c2ab-4721-937b-0d8ea2c60f06" released by "delete_volume" :: held 0.831s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:34 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 Sep 03 11:13:34 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created reservations ['dd567e95-1800-4bfa-916d-04de215a7383', 'b7345b94-4acc-4b96-a417-d2e7606bff55', '643456b6-a866-46d4-a9ac-04bed0fcf01f', 'e8b49e47-21e9-4b27-8bba-7c010cb8687a'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:34 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:34 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-37d4f7b0-eaf0-41e8-a906-0301b995e65f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:34 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-37d4f7b0-eaf0-41e8-a906-0301b995e65f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-quobyte-37d4f7b0-eaf0-41e8-a906-0301b995e65f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-37d4f7b0-eaf0-41e8-a906-0301b995e65f" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:35 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20" returned: 0 in 0.573s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e7df29-c4d4-4864-9c4b-989837da2e17]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[bace5a47-f055-4e2f-8b31-e26fc3d44903]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:35 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.445s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:35 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Deleted volume successfully. Sep 03 11:13:35 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 Sep 03 11:13:35 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:35 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f Sep 03 11:13:35 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-a22bd1cf-3c03-465b-9ba8-bd5f2e56961b tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-809e319c-c2ab-4721-937b-0d8ea2c60f06-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:35 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0" returned: 0 in 0.555s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:35 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f" returned: 0 in 0.601s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:35 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 Sep 03 11:13:35 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:35 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f Sep 03 11:13:35 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:35 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Flow 'volume_create_manager' (fff02c2b-ff9b-4140-8b2a-eb1127aa6159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55e84f2-e43f-4867-b978-62314272686f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55e84f2-e43f-4867-b978-62314272686f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830054409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd098f6e-466b-4982-ae77-c51c043887eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175f819b7a674c6481d2030b0301bd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:36Z,use_quota=True,user_id='6f7aa37223ce49f1a82b4c1bd1a96c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777ab170-e9c4-4d60-8d6f-780d608840d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777ab170-e9c4-4d60-8d6f-780d608840d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f2b8a9-c735-4fc9-8eec-14b3b25f4399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f2b8a9-c735-4fc9-8eec-14b3b25f4399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd098f6e-466b-4982-ae77-c51c043887eb', 'volume_name': 'volume-bd098f6e-466b-4982-ae77-c51c043887eb', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d1da9e-c9ff-43c2-aca3-6e1c254b1aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d1da9e-c9ff-43c2-aca3-6e1c254b1aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:36 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96267cf8-b669-4146-b481-cba95507d126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:36 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Volume bd098f6e-466b-4982-ae77-c51c043887eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd098f6e-466b-4982-ae77-c51c043887eb', 'volume_size': 1} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830054409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd098f6e-466b-4982-ae77-c51c043887eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175f819b7a674c6481d2030b0301bd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:36Z,use_quota=True,user_id='6f7aa37223ce49f1a82b4c1bd1a96c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Creating volume bd098f6e-466b-4982-ae77-c51c043887eb {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:36 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-37d4f7b0-eaf0-41e8-a906-0301b995e65f" returned: 0 in 0.406s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:36 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb 1073741824 Sep 03 11:13:36 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-37d4f7b0-eaf0-41e8-a906-0301b995e65f" released by "delete_volume" :: held 1.127s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:36 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20" returned: 0 in 0.543s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created reservations ['c67c16cd-6ee7-44fe-8cf0-d45a6e2dbab5', '66afc4a4-a6e3-4d9e-bb71-2e8dbad272d6', '75706c3f-ecad-4c21-b4a6-7bb0ed0e8a1d', 'cf84824b-5941-4f52-ae54-008bbab42561'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:36 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20 Sep 03 11:13:36 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:36 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:36 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:36 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0.c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20" returned: 0 in 0.349s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20" released by "_delete_snapshot" :: held 2.201s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:36 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-e014f792-390d-4d7b-b0e1-a76ea15db7e0" released by "delete_snapshot" :: held 2.231s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.296s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:36 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Deleted volume successfully. Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb 1073741824" returned: 0 in 0.568s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b0f27bd2-c753-4d7e-a67e-1ac42d4f0182 tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-37d4f7b0-eaf0-41e8-a906-0301b995e65f-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:36 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb Sep 03 11:13:36 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Created reservations ['1dde5452-2a37-4011-8986-7fcec80ee413', '5e73c455-5bb7-4176-bf06-c304f54c114b', '7b7f3f95-b714-482f-a60f-287518367937', 'ea1c04df-c479-4a52-b747-1584b41969af'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Delete snapshot completed successfully. Sep 03 11:13:36 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b9d96377-0fda-4cec-a252-43a21b37dd0f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-c8bfdce8-0b04-40ba-bcaa-d4999e2e7e20-delete_snapshot" released by "delete_snapshot" :: held 2.484s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:37 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb" returned: 0 in 0.287s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96267cf8-b669-4146-b481-cba95507d126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd098f6e-466b-4982-ae77-c51c043887eb', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a06a6b7-e580-462e-906f-c9225bb35b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:37 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Volume volume-bd098f6e-466b-4982-ae77-c51c043887eb (bd098f6e-466b-4982-ae77-c51c043887eb): created successfully Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a06a6b7-e580-462e-906f-c9225bb35b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Flow 'volume_create_manager' (fff02c2b-ff9b-4140-8b2a-eb1127aa6159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=285,cinder:SELECT=219,cinder:DELETE=19,cinder:INSERT=80 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:13:37 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c52bb3d0-5c40-46e0-8ceb-9acebf344c48 tempest-ProjectReaderTests-734510700 None] Created volume successfully. Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-340beac7-ba0f-4efa-99b2-c0bc33647fb4-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-340beac7-ba0f-4efa-99b2-c0bc33647fb4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=209,cinder:UPDATE=295,cinder:INSERT=77,cinder:DELETE=33 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "cinder-quobyte-340beac7-ba0f-4efa-99b2-c0bc33647fb4" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-340beac7-ba0f-4efa-99b2-c0bc33647fb4" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f6a94c-26ae-4bc5-af7a-eed09ac7ee1c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:37 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 Sep 03 11:13:37 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-e014f792-390d-4d7b-b0e1-a76ea15db7e0-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-e014f792-390d-4d7b-b0e1-a76ea15db7e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-e014f792-390d-4d7b-b0e1-a76ea15db7e0" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-e014f792-390d-4d7b-b0e1-a76ea15db7e0" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[898a14cb-5c30-4c54-bfa1-e9c420f2d2a7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:37 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4" returned: 0 in 0.404s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:37 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4 Sep 03 11:13:37 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:37 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 Sep 03 11:13:37 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:38 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-340beac7-ba0f-4efa-99b2-c0bc33647fb4" returned: 0 in 0.298s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-quobyte-340beac7-ba0f-4efa-99b2-c0bc33647fb4" released by "delete_volume" :: held 0.750s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Created reservations ['4417e241-c00c-4b08-a9ca-3ec211bfa140', 'c36b7956-25ab-4136-935c-c3017cfe9909', 'ebc8a1ce-c771-4247-bccb-57300915a632', '0f2741e4-fceb-42fb-b6d0-bad9d2dbc40c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:38 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0" returned: 0 in 0.508s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:38 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0 Sep 03 11:13:38 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:38 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:38 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Acquiring lock "cinder-bd098f6e-466b-4982-ae77-c51c043887eb-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Lock "cinder-bd098f6e-466b-4982-ae77-c51c043887eb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:38 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e014f792-390d-4d7b-b0e1-a76ea15db7e0" returned: 0 in 0.322s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-e014f792-390d-4d7b-b0e1-a76ea15db7e0" released by "delete_volume" :: held 0.900s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Acquiring lock "cinder-quobyte-bd098f6e-466b-4982-ae77-c51c043887eb" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:38 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.349s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Lock "cinder-quobyte-bd098f6e-466b-4982-ae77-c51c043887eb" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:38 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Deleted volume successfully. Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea49650-ff37-473a-bd4e-b44c0544decb]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Created reservations ['6c864c03-6252-4144-ac12-e5fc48abd003', '2fbb62e8-06f9-4cc7-9a55-a121a761d7b7', '3a8f3ef0-f6cc-42e9-a595-7c3b17623889', '4e4eab80-8718-4c3e-9260-3b14fb4a94f5'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21412467-f3d0-4cb6-8ad9-f634c19d780c tempest-CreateVolumesFromSourceVolumeTest-2026621474 None] Lock "cinder-340beac7-ba0f-4efa-99b2-c0bc33647fb4-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:38 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb Sep 03 11:13:38 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:38 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:38 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:39 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Deleted volume successfully. Sep 03 11:13:39 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb" returned: 0 in 0.420s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-61bf6b17-108f-42b0-b359-05f355a3cb3f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-e014f792-390d-4d7b-b0e1-a76ea15db7e0-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:39 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb Sep 03 11:13:39 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:39 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bd098f6e-466b-4982-ae77-c51c043887eb" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Lock "cinder-quobyte-bd098f6e-466b-4982-ae77-c51c043887eb" released by "delete_volume" :: held 0.740s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Created reservations ['57bb73f7-3d66-4188-9e87-d346db18c15a', '887d6571-a29d-4599-aece-164e7ff391a1', '1a72c8c6-6dbe-4bd7-808d-a6470481aa35', 'df3c7b2b-cc32-4a22-85ce-d493f94a11ae'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:39 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:39 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:39 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.294s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Deleted volume successfully. Sep 03 11:13:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ef0b1f79-cb5d-4044-88a5-9b2147cf4611 tempest-ProjectReaderTests-734510700 None] Lock "cinder-bd098f6e-466b-4982-ae77-c51c043887eb-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Flow 'volume_create_manager' (6620c637-8979-4d69-9410-9b20e31bbbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c207e5-6abe-48f6-81f7-33e83115ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c207e5-6abe-48f6-81f7-33e83115ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247884691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9597e7a-aa6e-496c-9560-1e7060061049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175f819b7a674c6481d2030b0301bd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:41Z,use_quota=True,user_id='6f7aa37223ce49f1a82b4c1bd1a96c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d59a9-d6d3-4886-88c7-f542e0ca2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d59a9-d6d3-4886-88c7-f542e0ca2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bcd036-c5ce-4591-9578-585420b8c7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bcd036-c5ce-4591-9578-585420b8c7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9597e7a-aa6e-496c-9560-1e7060061049', 'volume_name': 'volume-b9597e7a-aa6e-496c-9560-1e7060061049', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7c65ed-1f57-496b-ac82-46aa742d1a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7c65ed-1f57-496b-ac82-46aa742d1a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e6716c-194f-430a-806b-de9971305440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Volume b9597e7a-aa6e-496c-9560-1e7060061049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9597e7a-aa6e-496c-9560-1e7060061049', 'volume_size': 1} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247884691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9597e7a-aa6e-496c-9560-1e7060061049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175f819b7a674c6481d2030b0301bd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:41Z,use_quota=True,user_id='6f7aa37223ce49f1a82b4c1bd1a96c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Creating volume b9597e7a-aa6e-496c-9560-1e7060061049 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:40 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:40 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049 1073741824 Sep 03 11:13:40 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (27d6b3f4-b85a-45f1-927b-b54cdcfa12ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7b5b64-c18b-4887-a7cb-582f06e3be00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7b5b64-c18b-4887-a7cb-582f06e3be00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304705440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:41Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e25606-dd3f-48de-bf1c-f6c07f8090e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e25606-dd3f-48de-bf1c-f6c07f8090e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7764486-d66a-499e-8ca1-2aa88e2545ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7764486-d66a-499e-8ca1-2aa88e2545ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa', 'volume_name': 'volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfb48c8-cbb0-4a15-99f5-617714c56d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfb48c8-cbb0-4a15-99f5-617714c56d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b03c9e-1204-45de-928b-ce6ee4d988de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:40 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Volume f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa', 'volume_size': 1} Sep 03 11:13:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:41 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049 1073741824" returned: 0 in 0.452s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:41 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049 Sep 03 11:13:41 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:41 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049" returned: 0 in 0.266s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304705440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:41Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Creating volume f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:41 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e6716c-194f-430a-806b-de9971305440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9597e7a-aa6e-496c-9560-1e7060061049', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b2508d-a652-486b-9513-2e9def5316f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:41 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa 1073741824 Sep 03 11:13:41 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:41 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Volume volume-b9597e7a-aa6e-496c-9560-1e7060061049 (b9597e7a-aa6e-496c-9560-1e7060061049): created successfully Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b2508d-a652-486b-9513-2e9def5316f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Flow 'volume_create_manager' (6620c637-8979-4d69-9410-9b20e31bbbee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9b562fba-3402-4bdd-9ffc-7be78f568a73 tempest-ProjectReaderTests-734510700 None] Created volume successfully. Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Flow 'volume_create_manager' (db15b712-1d82-4fb3-9440-0c1d4c1d414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7476f307-df62-49e1-94d0-689e264f0786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7476f307-df62-49e1-94d0-689e264f0786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-606970035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9675421cfbe64fd89c432df3b00957b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:42Z,use_quota=True,user_id='544f2ab6e67f43f0b76e242e1169e785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b03cbe-c4cf-4447-8bf6-90d0b6532cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b03cbe-c4cf-4447-8bf6-90d0b6532cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9420c43-0637-438e-ab63-f765f6caef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9420c43-0637-438e-ab63-f765f6caef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f', 'volume_name': 'volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07328802-8799-4e4a-9d9f-a7de1f78df5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07328802-8799-4e4a-9d9f-a7de1f78df5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fab9dff-cb88-4495-9d41-4b2952130dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:41 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Volume e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f', 'volume_size': 1} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:41 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa 1073741824" returned: 0 in 0.447s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:41 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa Sep 03 11:13:41 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:42 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" returned: 0 in 0.242s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-606970035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9675421cfbe64fd89c432df3b00957b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:42Z,use_quota=True,user_id='544f2ab6e67f43f0b76e242e1169e785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Creating volume e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:42 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b03c9e-1204-45de-928b-ce6ee4d988de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d20eed-034c-402b-be73-299802d79978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:42 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f 1073741824 Sep 03 11:13:42 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:42 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Volume volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa (f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa): created successfully Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d20eed-034c-402b-be73-299802d79978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (27d6b3f4-b85a-45f1-927b-b54cdcfa12ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:42 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-65f9a779-1e7b-4d4c-9f40-2224457a570f tempest-ProjectMemberTests-1440316641 None] Created volume successfully. Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Acquiring lock "cinder-b9597e7a-aa6e-496c-9560-1e7060061049-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Lock "cinder-b9597e7a-aa6e-496c-9560-1e7060061049-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Acquiring lock "cinder-quobyte-b9597e7a-aa6e-496c-9560-1e7060061049" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Lock "cinder-quobyte-b9597e7a-aa6e-496c-9560-1e7060061049" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf3bae-81f6-4e1b-8cdd-10c8f44f1688]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:42 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f 1073741824" returned: 0 in 0.508s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:42 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049 Sep 03 11:13:42 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:42 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f Sep 03 11:13:42 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:43 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049" returned: 0 in 0.421s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:43 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.256s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:43 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049 Sep 03 11:13:43 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fab9dff-cb88-4495-9d41-4b2952130dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be92574d-66d7-41d6-9ae0-dc508be2ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Creating offline snapshot 584c8c5c-51db-428a-a507-39987e8fb304 of volume f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:13:43 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Volume volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f (e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f): created successfully Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be92574d-66d7-41d6-9ae0-dc508be2ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Flow 'volume_create_manager' (db15b712-1d82-4fb3-9440-0c1d4c1d414b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1166e5-2c61-4216-8f13-c5d832fcf1c6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-021dc001-02a3-42c5-bdb6-842029ccc7c0 tempest-VolumeDependencyTests-1109423978 None] Created volume successfully. Sep 03 11:13:43 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa Sep 03 11:13:43 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:43 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-b9597e7a-aa6e-496c-9560-1e7060061049" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Lock "cinder-quobyte-b9597e7a-aa6e-496c-9560-1e7060061049" released by "delete_volume" :: held 0.723s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Created reservations ['22b65881-40fb-4568-92d4-537d206cb7bc', 'a066dece-169d-48a8-92bf-b8b9e51b8a44', '7e3a2abc-a997-4f44-851c-007984fd6d80', '16a611a8-7edf-4670-908f-a5a00ba10180'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:43 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:43 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:43 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" returned: 0 in 0.381s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:43 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 1G Sep 03 11:13:43 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:43 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.265s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:43 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Deleted volume successfully. Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-57474037-9367-4b3f-a5f6-eea95bac86cf tempest-ProjectReaderTests-734510700 None] Lock "cinder-b9597e7a-aa6e-496c-9560-1e7060061049-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:43 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 1G" returned: 0 in 0.485s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:44 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 Sep 03 11:13:44 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:44 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304" returned: 0 in 0.339s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:44 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 is being set with open permissions: ugo+rw Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:44 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 Sep 03 11:13:44 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Flow 'volume_create_manager' (89b2cb91-39b4-41da-b888-06248ba03c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d0b12f-51df-4b3a-bdbf-90595026895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d0b12f-51df-4b3a-bdbf-90595026895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152440458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abf4341-6ab0-4b20-8df3-68f181e1aa56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175f819b7a674c6481d2030b0301bd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:44Z,use_quota=True,user_id='6f7aa37223ce49f1a82b4c1bd1a96c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c0738f-51f0-4485-9041-7cc5ec308d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c0738f-51f0-4485-9041-7cc5ec308d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d507ff47-13a7-4f32-b2b9-ad4715e9db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d507ff47-13a7-4f32-b2b9-ad4715e9db6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5abf4341-6ab0-4b20-8df3-68f181e1aa56', 'volume_name': 'volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3e75ef-83e6-449d-9654-66f43add4636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3e75ef-83e6-449d-9654-66f43add4636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4def60fb-2ab2-4c67-8dba-10ef7eb9dc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Volume 5abf4341-6ab0-4b20-8df3-68f181e1aa56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56', 'volume_size': 1} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:44 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304" returned: 0 in 0.258s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:44 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.info Sep 03 11:13:44 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:44 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.info" returned: 0 in 0.260s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:44 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.info is being set with open permissions: ugo+rw Sep 03 11:13:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:44 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.info Sep 03 11:13:44 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:45 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.info" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.822s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Creating offline snapshot 620135eb-ab73-48d2-918e-fce863e78e5a of volume e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cdec49-e100-4bf8-b1df-7aecdec6df6c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:45 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0c09bde2-163e-4b63-9b7b-50ba4ca88222 tempest-ProjectMemberTests-1440316641 None] Create snapshot completed successfully Sep 03 11:13:45 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f Sep 03 11:13:45 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:45 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" returned: 0 in 0.369s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:45 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a 1G Sep 03 11:13:45 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:45 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a 1G" returned: 0 in 0.401s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:45 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-584c8c5c-51db-428a-a507-39987e8fb304-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:45 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a Sep 03 11:13:45 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-584c8c5c-51db-428a-a507-39987e8fb304-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-584c8c5c-51db-428a-a507-39987e8fb304" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-584c8c5c-51db-428a-a507-39987e8fb304" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Deleting offline snapshot 584c8c5c-51db-428a-a507-39987e8fb304 of volume f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] snapshot_file for this snap is: volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1763dd6-8805-4e54-855e-67ad4f288c5e]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:46 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 Sep 03 11:13:46 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:46 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a" returned: 0 in 0.332s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:46 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a is being set with open permissions: ugo+rw Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:46 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a Sep 03 11:13:46 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:46 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304" returned: 0 in 0.369s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e3f49a-4ca6-463a-9f13-4d97811048e5]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:46 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a" returned: 0 in 0.258s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:46 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa Sep 03 11:13:46 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:46 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.info Sep 03 11:13:46 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:46 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.info" returned: 0 in 0.257s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:46 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.info is being set with open permissions: ugo+rw Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:46 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" returned: 0 in 0.377s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:46 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.info Sep 03 11:13:46 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:46 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 Sep 03 11:13:46 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:47 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.info" returned: 0 in 0.266s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.675s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152440458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abf4341-6ab0-4b20-8df3-68f181e1aa56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175f819b7a674c6481d2030b0301bd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:44Z,use_quota=True,user_id='6f7aa37223ce49f1a82b4c1bd1a96c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Creating volume 5abf4341-6ab0-4b20-8df3-68f181e1aa56 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:47 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:47 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 1073741824 Sep 03 11:13:47 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-59756851-f387-4586-9f8c-543a6c515cc5 tempest-VolumeDependencyTests-1109423978 None] Create snapshot completed successfully Sep 03 11:13:47 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304" returned: 0 in 0.374s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:47 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304 Sep 03 11:13:47 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:47 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa.584c8c5c-51db-428a-a507-39987e8fb304" returned: 0 in 0.275s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-584c8c5c-51db-428a-a507-39987e8fb304" released by "_delete_snapshot" :: held 1.493s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" released by "delete_snapshot" :: held 1.515s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Created reservations ['2b971eee-b429-44cb-b5d5-064c9cd74125', '843aebe3-53ab-487a-ae12-5fe191ba27d6', '05739f12-6b73-4429-85a1-f1bfd6150444', '5374833e-2a52-4897-a42b-48ffcf0fba2b'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:47 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 1073741824" returned: 0 in 0.481s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:47 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 Sep 03 11:13:47 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Delete snapshot completed successfully. Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-6771373b-b7dd-4bc9-a7fe-f5276e155cb6 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-584c8c5c-51db-428a-a507-39987e8fb304-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:47 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4def60fb-2ab2-4c67-8dba-10ef7eb9dc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f4e27e-6c9f-4cca-a084-a7c9687615e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:47 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Volume volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 (5abf4341-6ab0-4b20-8df3-68f181e1aa56): created successfully Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f4e27e-6c9f-4cca-a084-a7c9687615e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Flow 'volume_create_manager' (89b2cb91-39b4-41da-b888-06248ba03c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:47 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8903f68f-7be2-43b9-886d-34372575cee6 tempest-ProjectReaderTests-734510700 None] Created volume successfully. Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Lock "cinder-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" acquired by "delete_volume" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[16564588-6675-4d49-be04-b734d90ebbf1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:48 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa Sep 03 11:13:48 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Acquiring lock "cinder-5abf4341-6ab0-4b20-8df3-68f181e1aa56-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Lock "cinder-5abf4341-6ab0-4b20-8df3-68f181e1aa56-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Acquiring lock "cinder-quobyte-5abf4341-6ab0-4b20-8df3-68f181e1aa56" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Lock "cinder-quobyte-5abf4341-6ab0-4b20-8df3-68f181e1aa56" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c824c64f-eeae-441e-8cf8-18cccbc115c4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:48 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" returned: 0 in 0.468s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:48 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 Sep 03 11:13:48 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:48 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa Sep 03 11:13:48 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Flow 'volume_create_manager' (fdca58a2-457e-4cd4-868e-e72d56de0856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d50a4f-bba7-4963-99fb-09b942ba3fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d50a4f-bba7-4963-99fb-09b942ba3fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1258778152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115dbe7f-3e92-43d5-b730-b5b04995256e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9675421cfbe64fd89c432df3b00957b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=620135eb-ab73-48d2-918e-fce863e78e5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:49Z,use_quota=True,user_id='544f2ab6e67f43f0b76e242e1169e785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:49 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba34726-4199-4730-8be8-652ec0249b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba34726-4199-4730-8be8-652ec0249b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa41b1f2-ecbc-441d-a945-97c0b20403fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa41b1f2-ecbc-441d-a945-97c0b20403fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '115dbe7f-3e92-43d5-b730-b5b04995256e', 'volume_name': 'volume-115dbe7f-3e92-43d5-b730-b5b04995256e', 'volume_size': 1, 'snapshot_id': '620135eb-ab73-48d2-918e-fce863e78e5a'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438bdfe7-81a1-43ea-9d77-42de24f492cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438bdfe7-81a1-43ea-9d77-42de24f492cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c157d2a-9e7f-48cc-8ccc-0d85762c2b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:49 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Volume 115dbe7f-3e92-43d5-b730-b5b04995256e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-115dbe7f-3e92-43d5-b730-b5b04995256e', 'volume_size': 1, 'snapshot_id': '620135eb-ab73-48d2-918e-fce863e78e5a'} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" returned: 0 in 0.384s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:49 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56" returned: 0 in 0.515s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa" released by "delete_volume" :: held 0.939s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "cinder-quobyte-620135eb-ab73-48d2-918e-fce863e78e5a-115dbe7f-3e92-43d5-b730-b5b04995256e" by "_create_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:49 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56 Sep 03 11:13:49 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-620135eb-ab73-48d2-918e-fce863e78e5a-115dbe7f-3e92-43d5-b730-b5b04995256e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Creating volume 115dbe7f-3e92-43d5-b730-b5b04995256e from snapshot 620135eb-ab73-48d2-918e-fce863e78e5a {{(pid=86603) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "cinder-quobyte-115dbe7f-3e92-43d5-b730-b5b04995256e" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-115dbe7f-3e92-43d5-b730-b5b04995256e" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] snapshot: 620135eb-ab73-48d2-918e-fce863e78e5a, volume: 115dbe7f-3e92-43d5-b730-b5b04995256e, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52a2d1c-7305-45af-8981-eec36cdafed3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Created reservations ['507661da-9ac6-431c-a321-fa614ad1e0e2', 'e8a7459c-449d-457a-8a70-13ac01490189', '0cfbb1c1-0c4a-4559-a6db-512e753b8ea4', '5ef75863-1fbd-4e6e-b641-d49c88ed061c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:49 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:49 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a Sep 03 11:13:49 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:49 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:49 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-5abf4341-6ab0-4b20-8df3-68f181e1aa56" returned: 0 in 0.290s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Lock "cinder-quobyte-5abf4341-6ab0-4b20-8df3-68f181e1aa56" released by "delete_volume" :: held 0.870s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Created reservations ['d43bd420-87e7-4732-be77-640aa0f50fe4', '46a66451-19b2-4628-b844-b8469724c70c', 'a384d99b-aaf4-4f01-ac2a-fb3dd187bee0', 'ae6355aa-26ac-4876-b996-ceb85da95faf'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:49 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:49 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:49 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.300s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Deleted volume successfully. Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-157d9453-aff8-40c6-93fa-f69f35075b1d tempest-ProjectMemberTests-1440316641 None] Lock "cinder-f15ff0c1-e790-4ecb-9931-af7f5ed4d2aa-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:49 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a" returned: 0 in 0.453s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[460a2eef-c696-441d-927f-3092a8d6e8b8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:49 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f Sep 03 11:13:49 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:49 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.329s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Deleted volume successfully. Sep 03 11:13:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-85f9ec2e-1afc-46b8-a9db-63b077275ab5 tempest-ProjectReaderTests-734510700 None] Lock "cinder-5abf4341-6ab0-4b20-8df3-68f181e1aa56-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Flow 'volume_create_manager' (94f43159-f3d8-4469-9914-4e987066ed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:50 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99850ea1-00c3-43da-a6d8-37325a3d89a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" returned: 0 in 0.445s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99850ea1-00c3-43da-a6d8-37325a3d89a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058700229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee904d2-9b69-403a-ad70-eddfb07b4b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175f819b7a674c6481d2030b0301bd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:50Z,use_quota=True,user_id='6f7aa37223ce49f1a82b4c1bd1a96c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf826463-beca-43fb-a8ae-ffc64f7358cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:50 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e Sep 03 11:13:50 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf826463-beca-43fb-a8ae-ffc64f7358cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7e3bb9-be8e-42d7-8ace-a7f93e100c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7e3bb9-be8e-42d7-8ace-a7f93e100c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee904d2-9b69-403a-ad70-eddfb07b4b55', 'volume_name': 'volume-bee904d2-9b69-403a-ad70-eddfb07b4b55', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a6f631-ce9c-4898-87c7-33d8a4fed0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a6f631-ce9c-4898-87c7-33d8a4fed0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9d892a-6e4a-4ce1-a723-5f9b3946362a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:50 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Volume bee904d2-9b69-403a-ad70-eddfb07b4b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee904d2-9b69-403a-ad70-eddfb07b4b55', 'volume_size': 1} Sep 03 11:13:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (a16ab9b8-a077-49ad-bb7b-c7bfea1d0b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7168be78-bc5f-4c6b-b8e5-d1f53817e0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7168be78-bc5f-4c6b-b8e5-d1f53817e0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962422693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18c8951-2f21-40af-8a6b-9d0dc9176dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:51Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e50d96f-14f4-4d80-9bfb-1e64c0400796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e50d96f-14f4-4d80-9bfb-1e64c0400796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54388805-f144-4dd5-90d9-a4a6e1cccd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54388805-f144-4dd5-90d9-a4a6e1cccd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18c8951-2f21-40af-8a6b-9d0dc9176dcb', 'volume_name': 'volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43a6629-7f21-4f12-b249-62ef47c23c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43a6629-7f21-4f12-b249-62ef47c23c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2304fedc-ac06-466b-a981-0414504430f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:51 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Volume f18c8951-2f21-40af-8a6b-9d0dc9176dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb', 'volume_size': 1} Sep 03 11:13:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:54 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e" returned: 0 in 4.385s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:13:54 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Converted 1024.00 MB image at 233.43 MB/s Sep 03 11:13:54 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e is being set with open permissions: ugo+rw Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:54 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e Sep 03 11:13:54 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:54 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e" returned: 0 in 0.243s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-115dbe7f-3e92-43d5-b730-b5b04995256e" released by "_copy_volume_from_snapshot" :: held 5.628s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-620135eb-ab73-48d2-918e-fce863e78e5a-115dbe7f-3e92-43d5-b730-b5b04995256e" released by "_create_volume_from_snapshot" :: held 5.692s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.721s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.624s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058700229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee904d2-9b69-403a-ad70-eddfb07b4b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175f819b7a674c6481d2030b0301bd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:50Z,use_quota=True,user_id='6f7aa37223ce49f1a82b4c1bd1a96c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Creating volume bee904d2-9b69-403a-ad70-eddfb07b4b55 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:54 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:54 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 1073741824 Sep 03 11:13:54 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c157d2a-9e7f-48cc-8ccc-0d85762c2b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115dbe7f-3e92-43d5-b730-b5b04995256e', 'volume_size': 1, 'snapshot_id': '620135eb-ab73-48d2-918e-fce863e78e5a'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415273f3-4cc5-47e3-b686-13eec85adfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:54 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Volume volume-115dbe7f-3e92-43d5-b730-b5b04995256e (115dbe7f-3e92-43d5-b730-b5b04995256e): created successfully Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415273f3-4cc5-47e3-b686-13eec85adfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:54 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Flow 'volume_create_manager' (fdca58a2-457e-4cd4-868e-e72d56de0856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3748a346-16b0-4af6-bdb6-1a213828d0dd tempest-VolumeDependencyTests-1109423978 None] Created volume successfully. Sep 03 11:13:55 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 1073741824" returned: 0 in 0.402s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:55 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 Sep 03 11:13:55 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:55 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55" returned: 0 in 0.244s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.037s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962422693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18c8951-2f21-40af-8a6b-9d0dc9176dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:51Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Creating volume f18c8951-2f21-40af-8a6b-9d0dc9176dcb {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:55 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:55 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb 1073741824 Sep 03 11:13:55 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9d892a-6e4a-4ce1-a723-5f9b3946362a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee904d2-9b69-403a-ad70-eddfb07b4b55', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbfd0d6-037c-4e0f-bb7f-1d9cf80843f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:55 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Volume volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 (bee904d2-9b69-403a-ad70-eddfb07b4b55): created successfully Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbfd0d6-037c-4e0f-bb7f-1d9cf80843f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Flow 'volume_create_manager' (94f43159-f3d8-4469-9914-4e987066ed56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2fa807f5-5c69-4ea5-b52d-d3c1295aac01 tempest-ProjectReaderTests-734510700 None] Created volume successfully. Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "cinder-620135eb-ab73-48d2-918e-fce863e78e5a-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-620135eb-ab73-48d2-918e-fce863e78e5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "cinder-quobyte-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "cinder-quobyte-620135eb-ab73-48d2-918e-fce863e78e5a" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-620135eb-ab73-48d2-918e-fce863e78e5a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Deleting offline snapshot 620135eb-ab73-48d2-918e-fce863e78e5a of volume e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] snapshot_file for this snap is: volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb98a6ec-aeff-4d84-866a-4ba83a5503b3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Acquiring lock "cinder-bee904d2-9b69-403a-ad70-eddfb07b4b55-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Lock "cinder-bee904d2-9b69-403a-ad70-eddfb07b4b55-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:55 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a Sep 03 11:13:55 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Acquiring lock "cinder-quobyte-bee904d2-9b69-403a-ad70-eddfb07b4b55" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Lock "cinder-quobyte-bee904d2-9b69-403a-ad70-eddfb07b4b55" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad071a68-d0d7-4429-8c0e-54b4a01de2b7]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:56 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb 1073741824" returned: 0 in 0.535s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:56 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 Sep 03 11:13:56 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:56 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb Sep 03 11:13:56 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:56 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a" returned: 0 in 0.442s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28e8612-8337-43a9-90fb-c2ba9da6d154]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:56 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f Sep 03 11:13:56 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:56 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55" returned: 0 in 0.421s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:56 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" returned: 0 in 0.273s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:56 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55 Sep 03 11:13:56 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2304fedc-ac06-466b-a981-0414504430f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd54dd12-a4fb-4e33-bfd1-6f48c4704b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:56 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Volume volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb (f18c8951-2f21-40af-8a6b-9d0dc9176dcb): created successfully Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd54dd12-a4fb-4e33-bfd1-6f48c4704b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (a16ab9b8-a077-49ad-bb7b-c7bfea1d0b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-70cea0d0-0ff5-417d-b216-c5d909a9ca43 tempest-ProjectMemberTests-1440316641 None] Created volume successfully. Sep 03 11:13:56 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bee904d2-9b69-403a-ad70-eddfb07b4b55" returned: 0 in 0.260s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Lock "cinder-quobyte-bee904d2-9b69-403a-ad70-eddfb07b4b55" released by "delete_volume" :: held 0.723s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Created reservations ['e3f8e85e-a1e4-4fe2-a605-d7e878de15e4', '34f364f9-eddb-4f79-9e36-ae01674f5662', '7991f591-59e3-4868-b39a-299202725c81', '1a93e8ed-8baf-4257-93c6-fc3f9c0f0792'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:56 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" returned: 0 in 0.572s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:56 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:56 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:56 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a Sep 03 11:13:56 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:57 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.250s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Deleted volume successfully. Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-af07f731-4fda-49ad-be94-882dfbd82e1f tempest-ProjectReaderTests-734510700 None] Lock "cinder-bee904d2-9b69-403a-ad70-eddfb07b4b55-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:57 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a" returned: 0 in 0.380s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:57 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a Sep 03 11:13:57 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:57 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f.620135eb-ab73-48d2-918e-fce863e78e5a" returned: 0 in 0.278s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-620135eb-ab73-48d2-918e-fce863e78e5a" released by "_delete_snapshot" :: held 1.800s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" released by "delete_snapshot" :: held 1.830s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Created reservations ['6ddc15c3-6c60-4d6a-b414-d81aa1c201ea', 'fb6139db-f453-436c-a684-b24760fa9a54', '1b57e704-5a85-4a22-b2de-62b2b5794c4c', '9a52077d-3965-44e8-b8cb-3bbd8bb7ace8'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:57 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Delete snapshot completed successfully. Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-8634824b-9719-4a41-9b9f-94de068cc1b5 tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-620135eb-ab73-48d2-918e-fce863e78e5a-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Creating offline snapshot 0dce7392-6467-4f20-a266-5a6c4cd79956 of volume f18c8951-2f21-40af-8a6b-9d0dc9176dcb {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9b0fd1-d271-4e3f-9e14-1cbab8f33c45]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "cinder-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:57 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb Sep 03 11:13:57 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "cinder-quobyte-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[492dea76-a14d-4adb-a86c-e0e33e1050a6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:58 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f Sep 03 11:13:58 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:58 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" returned: 0 in 0.440s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:58 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 1G Sep 03 11:13:58 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:58 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" returned: 0 in 0.409s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:58 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f Sep 03 11:13:58 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:58 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 1G" returned: 0 in 0.479s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:58 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" returned: 0 in 0.307s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:58 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 Sep 03 11:13:58 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f" released by "delete_volume" :: held 0.799s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Created reservations ['44888388-ca4a-4385-aede-ab4af2447625', '61c2db04-52e9-4a83-b600-c9201774001f', '7da301dd-28ed-45ae-be3a-0d3425529258', '74f64a7c-95d2-4cbe-9b23-7402b16d80fb'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:58 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:13:58 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:59 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "cinder-115dbe7f-3e92-43d5-b730-b5b04995256e-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956" returned: 0 in 0.436s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:59 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 is being set with open permissions: ugo+rw Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-115dbe7f-3e92-43d5-b730-b5b04995256e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:59 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 Sep 03 11:13:59 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "cinder-quobyte-115dbe7f-3e92-43d5-b730-b5b04995256e" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:59 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.337s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-115dbe7f-3e92-43d5-b730-b5b04995256e" acquired by "delete_volume" :: waited 0.024s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:59 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Deleted volume successfully. Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d31564-5ef4-477c-a048-9c2a7dfdf115]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-837df4af-1605-4d4d-809c-bcbbb044663e tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-e2bc8ab0-cb75-463c-b6a4-7cecd7fdfa8f-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:59 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e Sep 03 11:13:59 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:59 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956" returned: 0 in 0.309s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:59 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.info Sep 03 11:13:59 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:59 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e" returned: 0 in 0.374s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:59 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e Sep 03 11:13:59 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:59 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.info" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:59 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.info is being set with open permissions: ugo+rw Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:59 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.info Sep 03 11:13:59 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:59 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-115dbe7f-3e92-43d5-b730-b5b04995256e" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-quobyte-115dbe7f-3e92-43d5-b730-b5b04995256e" released by "delete_volume" :: held 0.680s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Created reservations ['c3d88a4d-bb1c-46bc-a6e6-6b57b0330597', 'fb18888c-c3fe-4ee5-9bba-b3a7e64d9e31', '4543ecec-a202-4ecc-b8fc-d9fadcbbfe27', 'abc3b33a-2f9c-497c-b882-2af036dedb2e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:00 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.info" returned: 0 in 0.247s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-3ba20dcd-96c4-414b-a010-874e13f21af4 tempest-ProjectMemberTests-1440316641 None] Create snapshot completed successfully Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:00 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:00 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:00 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.252s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Deleted volume successfully. Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-562b8f9a-be4f-4aa4-a0fe-bc40fedef3cc tempest-VolumeDependencyTests-1109423978 None] Lock "cinder-115dbe7f-3e92-43d5-b730-b5b04995256e-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-0dce7392-6467-4f20-a266-5a6c4cd79956-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Lock "cinder-0dce7392-6467-4f20-a266-5a6c4cd79956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-0dce7392-6467-4f20-a266-5a6c4cd79956" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-0dce7392-6467-4f20-a266-5a6c4cd79956" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Deleting offline snapshot 0dce7392-6467-4f20-a266-5a6c4cd79956 of volume f18c8951-2f21-40af-8a6b-9d0dc9176dcb {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] snapshot_file for this snap is: volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[60060255-cb7b-4d1b-bcaa-cf9b1b62c0ae]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:01 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 Sep 03 11:14:01 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:01 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956" returned: 0 in 0.389s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f0037f-df63-44b6-bf93-8c91851856e9]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:01 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb Sep 03 11:14:01 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:01 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" returned: 0 in 0.382s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:01 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 Sep 03 11:14:01 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:02 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956" returned: 0 in 0.394s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:02 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956 Sep 03 11:14:02 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:02 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb.0dce7392-6467-4f20-a266-5a6c4cd79956" returned: 0 in 0.251s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-0dce7392-6467-4f20-a266-5a6c4cd79956" released by "_delete_snapshot" :: held 1.525s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" released by "delete_snapshot" :: held 1.550s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:02 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Created reservations ['61b1e750-2a31-4721-886e-83f78ab3fb2f', 'f8535164-2843-4fd3-aaee-9eb641a73eb8', 'cb800620-3edb-447f-9038-048bb56633ad', '0d563705-1778-4fe1-a0ef-0a47bb655c01'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Delete snapshot completed successfully. Sep 03 11:14:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e964fa9b-a734-4eb3-958f-4563ed1362ca tempest-ProjectMemberTests-1440316641 None] Lock "cinder-0dce7392-6467-4f20-a266-5a6c4cd79956-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-f18c8951-2f21-40af-8a6b-9d0dc9176dcb-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Lock "cinder-f18c8951-2f21-40af-8a6b-9d0dc9176dcb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce932d8-f816-41f4-852a-aef1a590a8f6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:03 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb Sep 03 11:14:03 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:03 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" returned: 0 in 0.384s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:03 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb Sep 03 11:14:03 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:03 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" returned: 0 in 0.254s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-f18c8951-2f21-40af-8a6b-9d0dc9176dcb" released by "delete_volume" :: held 0.693s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:03 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Created reservations ['f37783cc-105c-436a-9331-f96dd4a05429', '6c473a33-baee-4d9d-aa4d-fa143fd2269b', '763441ba-4662-465e-915c-4a736985ec58', 'f5999638-15f1-4241-b7cf-9f52774f682d'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:04 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:04 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:04 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.293s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:04 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Deleted volume successfully. Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-48e9a5a4-e1f1-477d-95f3-c23f56b91bbe tempest-ProjectMemberTests-1440316641 None] Lock "cinder-f18c8951-2f21-40af-8a6b-9d0dc9176dcb-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (a7cc8d0a-0974-4419-ad65-6498f4d9f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ace9eff-43cd-46a5-b373-b790aa199629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ace9eff-43cd-46a5-b373-b790aa199629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688399473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d928e7d6-f7f9-46f7-bfef-7793a049809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:05Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4b5d77-133c-4d63-980d-2edae160c1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4b5d77-133c-4d63-980d-2edae160c1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2abe34-88b3-43b6-b19c-17284e1caf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2abe34-88b3-43b6-b19c-17284e1caf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd928e7d6-f7f9-46f7-bfef-7793a049809f', 'volume_name': 'volume-d928e7d6-f7f9-46f7-bfef-7793a049809f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8588e889-a886-475e-97cc-013e81ded57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8588e889-a886-475e-97cc-013e81ded57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c57357a-9076-49ab-83ab-acebd15d5bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:04 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Volume d928e7d6-f7f9-46f7-bfef-7793a049809f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d928e7d6-f7f9-46f7-bfef-7793a049809f', 'volume_size': 1} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688399473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d928e7d6-f7f9-46f7-bfef-7793a049809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:05Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Creating volume d928e7d6-f7f9-46f7-bfef-7793a049809f {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:04 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:14:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:04 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f 1073741824 Sep 03 11:14:04 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:05 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f 1073741824" returned: 0 in 0.435s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:05 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f Sep 03 11:14:05 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:05 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f" returned: 0 in 0.286s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:05 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c57357a-9076-49ab-83ab-acebd15d5bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d928e7d6-f7f9-46f7-bfef-7793a049809f', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f88061-d0a3-490a-ba96-6a3b91f82b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:05 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Volume volume-d928e7d6-f7f9-46f7-bfef-7793a049809f (d928e7d6-f7f9-46f7-bfef-7793a049809f): created successfully Sep 03 11:14:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f88061-d0a3-490a-ba96-6a3b91f82b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (a7cc8d0a-0974-4419-ad65-6498f4d9f188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:05 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-391e380e-68f0-474a-95a8-ddcb55a670c6 tempest-ProjectMemberTests-1440316641 None] Created volume successfully. Sep 03 11:14:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:06 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Creating offline snapshot fec08cfc-f9d8-4fac-bb07-b678770f196a of volume d928e7d6-f7f9-46f7-bfef-7793a049809f {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:14:06 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5d5db7-91a2-4f26-b15c-e6e4f51c26ea]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:06 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f Sep 03 11:14:06 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:06 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f" returned: 0 in 0.373s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:06 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a 1G Sep 03 11:14:06 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:06 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a 1G" returned: 0 in 0.393s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d928e7d6-f7f9-46f7-bfef-7793a049809f -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:06 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d928e7d6-f7f9-46f7-bfef-7793a049809f -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a Sep 03 11:14:06 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:07 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d928e7d6-f7f9-46f7-bfef-7793a049809f -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a" returned: 0 in 0.315s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:07 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a is being set with open permissions: ugo+rw Sep 03 11:14:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:07 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a Sep 03 11:14:07 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:07 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a" returned: 0 in 0.248s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:07 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.info Sep 03 11:14:07 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:07 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.info" returned: 0 in 0.278s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:07 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.info is being set with open permissions: ugo+rw Sep 03 11:14:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:07 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.info Sep 03 11:14:07 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:08 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.info" returned: 0 in 0.251s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:08 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0ead0b92-9383-458e-9e2d-47f639d4cd1a tempest-ProjectMemberTests-1440316641 None] Create snapshot completed successfully Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-fec08cfc-f9d8-4fac-bb07-b678770f196a-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Lock "cinder-fec08cfc-f9d8-4fac-bb07-b678770f196a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-d928e7d6-f7f9-46f7-bfef-7793a049809f" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-d928e7d6-f7f9-46f7-bfef-7793a049809f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-fec08cfc-f9d8-4fac-bb07-b678770f196a" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-fec08cfc-f9d8-4fac-bb07-b678770f196a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Deleting offline snapshot fec08cfc-f9d8-4fac-bb07-b678770f196a of volume d928e7d6-f7f9-46f7-bfef-7793a049809f {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] snapshot_file for this snap is: volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1da797-1f08-4fb1-8660-1b2cfea6b303]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:08 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a Sep 03 11:14:08 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:08 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a" returned: 0 in 0.384s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d928e7d6-f7f9-46f7-bfef-7793a049809f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[771ddd4f-d508-4540-b580-de911356ac49]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:08 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f Sep 03 11:14:08 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:09 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f" returned: 0 in 0.397s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:09 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a Sep 03 11:14:09 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:09 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a" returned: 0 in 0.366s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:09 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a Sep 03 11:14:09 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:09 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f.fec08cfc-f9d8-4fac-bb07-b678770f196a" returned: 0 in 0.262s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-fec08cfc-f9d8-4fac-bb07-b678770f196a" released by "_delete_snapshot" :: held 1.508s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-d928e7d6-f7f9-46f7-bfef-7793a049809f" released by "delete_snapshot" :: held 1.531s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:09 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Created reservations ['c9e7b4ce-def0-475d-b2c5-c4433f57297d', '72ca1c35-6512-4415-a4b5-c32de0dc9178', '7a221e4d-a8c3-4947-896d-86d77bf8158e', '8e28f9f0-9a41-44de-ba1c-643f8226193e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Delete snapshot completed successfully. Sep 03 11:14:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-731641c9-cf4c-423f-aaea-915149597e1b tempest-ProjectMemberTests-1440316641 None] Lock "cinder-fec08cfc-f9d8-4fac-bb07-b678770f196a-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-d928e7d6-f7f9-46f7-bfef-7793a049809f-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-d928e7d6-f7f9-46f7-bfef-7793a049809f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-d928e7d6-f7f9-46f7-bfef-7793a049809f" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-d928e7d6-f7f9-46f7-bfef-7793a049809f" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:10 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f3b237-dcb3-4a8c-b765-12472986507a]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:10 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f Sep 03 11:14:10 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:10 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f" returned: 0 in 0.392s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:11 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f Sep 03 11:14:11 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:11 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-d928e7d6-f7f9-46f7-bfef-7793a049809f" returned: 0 in 0.270s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-d928e7d6-f7f9-46f7-bfef-7793a049809f" released by "delete_volume" :: held 0.725s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Created reservations ['ba8b246f-f1ab-4f03-8201-c05f1fc3dc9e', '2e26c217-d6f2-4a23-ae26-27ae33c61f49', 'd3d956cf-5234-41de-b0e4-bff6ca1eb581', 'ca46c91b-def4-4f54-b40e-da7f1a6abb25'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:11 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:11 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:11 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.259s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:11 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Deleted volume successfully. Sep 03 11:14:11 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-4f851236-9796-4d93-97c5-e203627d4bc8 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-d928e7d6-f7f9-46f7-bfef-7793a049809f-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (e3a3d231-0ee1-43dd-8625-a6680608357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be22aa3c-8d66-4d79-a357-f9d6f36b0746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be22aa3c-8d66-4d79-a357-f9d6f36b0746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603421579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:12Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca05afe-c3f2-442e-b807-b7d782237545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca05afe-c3f2-442e-b807-b7d782237545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5504401b-a02e-4de1-b886-3e9b6445dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5504401b-a02e-4de1-b886-3e9b6445dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3', 'volume_name': 'volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87bd3c0-447e-46ea-9b60-150a5df9819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87bd3c0-447e-46ea-9b60-150a5df9819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69845022-080d-4c06-934b-901e3fadff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:12 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Volume 7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3', 'volume_size': 1} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603421579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:12Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Creating volume 7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:12 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:12 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 1073741824 Sep 03 11:14:12 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:12 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 1073741824" returned: 0 in 0.407s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:12 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 Sep 03 11:14:12 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:12 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" returned: 0 in 0.241s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69845022-080d-4c06-934b-901e3fadff5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da3e09c-3bf1-4fa7-bf68-46f1bd5dd572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:12 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Volume volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 (7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3): created successfully Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da3e09c-3bf1-4fa7-bf68-46f1bd5dd572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:12 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (e3a3d231-0ee1-43dd-8625-a6680608357a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:12 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b38fcd65-bf96-490f-8043-e1223f2f1f9b tempest-ProjectMemberTests-1440316641 None] Created volume successfully. Sep 03 11:14:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:13 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Creating offline snapshot 8be498e9-5126-40e7-93ec-2c781ccd807e of volume 7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:14:13 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[df259094-53ae-40e6-9b38-6615e63b8a35]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:13 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 Sep 03 11:14:13 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:13 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" returned: 0 in 0.358s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:13 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e 1G Sep 03 11:14:13 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:13 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e 1G" returned: 0 in 0.381s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:13 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:14 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e Sep 03 11:14:14 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:14 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e" returned: 0 in 0.283s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:14 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e is being set with open permissions: ugo+rw Sep 03 11:14:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:14 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e Sep 03 11:14:14 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:14 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e" returned: 0 in 0.231s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:14 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.info Sep 03 11:14:14 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:14 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.info" returned: 0 in 0.244s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:14 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.info is being set with open permissions: ugo+rw Sep 03 11:14:14 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:14 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.info Sep 03 11:14:14 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:14 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.info" returned: 0 in 0.232s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.802s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:15 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-9c37c05d-f64b-4f85-afa5-8df51651942e tempest-ProjectMemberTests-1440316641 None] Create snapshot completed successfully Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-8be498e9-5126-40e7-93ec-2c781ccd807e-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-8be498e9-5126-40e7-93ec-2c781ccd807e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-8be498e9-5126-40e7-93ec-2c781ccd807e" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-8be498e9-5126-40e7-93ec-2c781ccd807e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Deleting offline snapshot 8be498e9-5126-40e7-93ec-2c781ccd807e of volume 7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] snapshot_file for this snap is: volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3e72cc-09c6-45e1-a077-160a9a372911]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:15 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e Sep 03 11:14:15 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:15 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e" returned: 0 in 0.361s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c73c71-7ab4-450d-904d-e5a1e6ad74fd]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:15 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:15 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 Sep 03 11:14:15 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:16 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" returned: 0 in 0.357s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:16 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e Sep 03 11:14:16 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:16 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e" returned: 0 in 0.323s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:16 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e Sep 03 11:14:16 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:16 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:16 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3.8be498e9-5126-40e7-93ec-2c781ccd807e" returned: 0 in 0.234s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-8be498e9-5126-40e7-93ec-2c781ccd807e" released by "_delete_snapshot" :: held 1.362s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" released by "delete_snapshot" :: held 1.383s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:16 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Created reservations ['1878d2ad-3126-4044-b43b-42bbc21e0a68', 'c3589cd3-749d-478e-a8f8-1f01127c1395', '96e7d389-d06c-4496-8813-8a8b7a792c0d', '50b01065-08db-4146-a68a-3df48194a80e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:16 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Delete snapshot completed successfully. Sep 03 11:14:16 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-178ae419-9363-462c-beaa-dad3dffe6f69 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-8be498e9-5126-40e7-93ec-2c781ccd807e-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:17 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" acquired by "delete_volume" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:17 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b64645-9a1d-421e-9344-e1a16a16f0b3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:17 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 Sep 03 11:14:17 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:17 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" returned: 0 in 0.346s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:17 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:17 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3 Sep 03 11:14:17 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:18 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" returned: 0 in 0.240s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3" released by "delete_volume" :: held 0.641s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Created reservations ['c42733cb-1475-4916-afb3-c3b00df874df', '24479638-ef57-4397-abd2-06686fdbcd7e', 'd9b40dcc-6907-4a0e-a6a0-4e3667428105', 'dfa0607e-cc9e-4271-8851-3e300382283a'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:18 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:18 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:18 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.229s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:18 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Deleted volume successfully. Sep 03 11:14:18 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-c13aa1b7-bb62-4e0f-9247-0627a14f893a tempest-ProjectMemberTests-1440316641 None] Lock "cinder-7eaac0e4-98d9-421c-ae7f-fcc5bff75eb3-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (c9f266ee-00db-46a8-a626-40d37ef9512d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcdee09-c5c5-4945-b448-f1d15ffc6fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcdee09-c5c5-4945-b448-f1d15ffc6fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1162809784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:19Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2d84ef-c29b-4284-a8b3-0349e6580049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2d84ef-c29b-4284-a8b3-0349e6580049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633bdf95-13bd-4797-8be7-7c2326ce5d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633bdf95-13bd-4797-8be7-7c2326ce5d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9', 'volume_name': 'volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31284783-eaea-4a4a-90ca-bef25f3a6a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31284783-eaea-4a4a-90ca-bef25f3a6a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdb4bad-88d2-45fb-b0ba-8da581b1b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:19 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Volume bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9', 'volume_size': 1} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1162809784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:19Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Creating volume bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:19 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:19 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 1073741824 Sep 03 11:14:19 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:19 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 1073741824" returned: 0 in 0.398s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:19 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 Sep 03 11:14:19 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:19 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" returned: 0 in 0.242s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdb4bad-88d2-45fb-b0ba-8da581b1b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aafb49a-7e45-4d94-a1d9-2c0e0495ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:19 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Volume volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 (bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9): created successfully Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aafb49a-7e45-4d94-a1d9-2c0e0495ca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:19 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (c9f266ee-00db-46a8-a626-40d37ef9512d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:19 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-342a7625-cbcf-4b89-b3e4-df5246b139ac tempest-ProjectMemberTests-1440316641 None] Created volume successfully. Sep 03 11:14:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:20 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Creating offline snapshot 7a2965bd-fa8d-4857-9e22-872482b79241 of volume bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:14:20 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfc0605-4360-4694-83c9-971890a387d3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:20 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 Sep 03 11:14:20 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:20 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" returned: 0 in 0.341s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:20 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 1G Sep 03 11:14:20 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:20 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 1G" returned: 0 in 0.368s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:20 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:20 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 Sep 03 11:14:20 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:21 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241" returned: 0 in 0.293s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:21 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 is being set with open permissions: ugo+rw Sep 03 11:14:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:21 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 Sep 03 11:14:21 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:21 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241" returned: 0 in 0.230s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:21 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.info Sep 03 11:14:21 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:21 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.info" returned: 0 in 0.242s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:21 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.info is being set with open permissions: ugo+rw Sep 03 11:14:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:21 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.info Sep 03 11:14:21 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:21 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.info" returned: 0 in 0.227s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:21 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.775s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:22 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-aa78d4f7-9a20-4737-b5b7-31df88715e6d tempest-ProjectMemberTests-1440316641 None] Create snapshot completed successfully Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-7a2965bd-fa8d-4857-9e22-872482b79241-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-7a2965bd-fa8d-4857-9e22-872482b79241-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-7a2965bd-fa8d-4857-9e22-872482b79241" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7a2965bd-fa8d-4857-9e22-872482b79241" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Deleting offline snapshot 7a2965bd-fa8d-4857-9e22-872482b79241 of volume bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] snapshot_file for this snap is: volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc8eb48-ddba-486f-80ee-7b59822dc6fa]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:22 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 Sep 03 11:14:22 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:22 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241" returned: 0 in 0.351s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba68092-04ea-4265-bd1a-24a5e473fc8f]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:22 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:22 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 Sep 03 11:14:22 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:23 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" returned: 0 in 0.350s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:23 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 Sep 03 11:14:23 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:23 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241" returned: 0 in 0.322s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:23 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:23 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:23 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241 Sep 03 11:14:23 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:23 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.250s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:14:23 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9.7a2965bd-fa8d-4857-9e22-872482b79241" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7a2965bd-fa8d-4857-9e22-872482b79241" released by "_delete_snapshot" :: held 1.384s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" released by "delete_snapshot" :: held 1.406s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Created reservations ['f9d067f0-1224-4b99-8668-36e4449b17fd', '391ead17-c910-46cc-9366-01fb8bda82a3', '1a4803d4-3ed4-416b-b92d-20fdd6ae4971', '5e0fec61-5bd0-417d-880d-78e1e91a4479'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:23 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Delete snapshot completed successfully. Sep 03 11:14:23 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-e1f0f6fa-91ce-4beb-87eb-412f8156d10f tempest-ProjectMemberTests-1440316641 None] Lock "cinder-7a2965bd-fa8d-4857-9e22-872482b79241-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Lock "cinder-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccc4c1e-2551-481d-a6df-a48033fa12f6]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:24 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 Sep 03 11:14:24 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:24 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" returned: 0 in 0.348s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:24 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9 Sep 03 11:14:24 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:25 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" returned: 0 in 0.246s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9" released by "delete_volume" :: held 0.648s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Created reservations ['f5a0e5b0-1e0e-4caf-91f5-036893f0ccd1', 'f3f58b6f-8551-4e29-bade-201fd0362ce9', '01c32cd2-2cb6-4d9c-84d7-6b6b26347964', '328a2f9b-1f19-40ec-bfc5-97ac3e285e2c'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:25 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:25 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:25 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.248s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Deleted volume successfully. Sep 03 11:14:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-891dfce1-f098-4d19-a253-118a2e85666c tempest-ProjectMemberTests-1440316641 None] Lock "cinder-bb0991cd-00d4-49a3-be0a-92ba2ae0ffc9-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (a0bedc2b-73b0-4fe9-bbfa-083bd5a2de32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa63003c-d575-4a63-8f94-9bf205c5ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa63003c-d575-4a63-8f94-9bf205c5ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269211219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e579b88-dfa6-4fe4-bd73-1423838ebce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:26Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6eb9ae-2da1-48a1-a428-db4692c25aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6eb9ae-2da1-48a1-a428-db4692c25aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cb6ca2-1463-4bf3-a5dd-de35e3f8855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cb6ca2-1463-4bf3-a5dd-de35e3f8855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e579b88-dfa6-4fe4-bd73-1423838ebce4', 'volume_name': 'volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cb0aa8-b6be-4512-a7e7-175c0bb3131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cb0aa8-b6be-4512-a7e7-175c0bb3131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfdb32d-bd13-4cb7-9584-9f9eb8eaf0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:26 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Volume 7e579b88-dfa6-4fe4-bd73-1423838ebce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4', 'volume_size': 1} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269211219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e579b88-dfa6-4fe4-bd73-1423838ebce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820692f6cbc647aaa7fca068812b4259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:26Z,use_quota=True,user_id='558f1a5a97264aa7bd8e73cb8abf4c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Creating volume 7e579b88-dfa6-4fe4-bd73-1423838ebce4 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:26 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:26 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 1073741824 Sep 03 11:14:26 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:26 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 1073741824" returned: 0 in 0.400s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:26 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 Sep 03 11:14:26 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:26 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4" returned: 0 in 0.244s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfdb32d-bd13-4cb7-9584-9f9eb8eaf0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224e328d-64ff-4b3a-a8a4-ad954174fcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:26 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Volume volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 (7e579b88-dfa6-4fe4-bd73-1423838ebce4): created successfully Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224e328d-64ff-4b3a-a8a4-ad954174fcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Flow 'volume_create_manager' (a0bedc2b-73b0-4fe9-bbfa-083bd5a2de32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:26 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-8ca87ed0-6139-48c8-931a-57cf37b8747d tempest-ProjectMemberTests-1440316641 None] Created volume successfully. Sep 03 11:14:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Creating offline snapshot 19ab9877-4302-4577-bfdc-9fc4071f6d0a of volume 7e579b88-dfa6-4fe4-bd73-1423838ebce4 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:14:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ebf5f8-328b-4531-83bb-fc714495a136]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:27 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 Sep 03 11:14:27 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:27 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4" returned: 0 in 0.347s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:27 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a 1G Sep 03 11:14:27 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:27 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a 1G" returned: 0 in 0.376s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:28 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a Sep 03 11:14:28 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:28 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a" returned: 0 in 0.307s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:28 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a is being set with open permissions: ugo+rw Sep 03 11:14:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:28 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a Sep 03 11:14:28 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:28 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a" returned: 0 in 0.232s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:28 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.info Sep 03 11:14:28 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:28 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.info" returned: 0 in 0.251s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:28 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.info is being set with open permissions: ugo+rw Sep 03 11:14:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:28 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.info Sep 03 11:14:28 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:29 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.info" returned: 0 in 0.237s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:29 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b7ead55a-abf2-4e34-b042-58dd059f2893 tempest-ProjectMemberTests-1440316641 None] Create snapshot completed successfully Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-19ab9877-4302-4577-bfdc-9fc4071f6d0a-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-19ab9877-4302-4577-bfdc-9fc4071f6d0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-7e579b88-dfa6-4fe4-bd73-1423838ebce4" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7e579b88-dfa6-4fe4-bd73-1423838ebce4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-19ab9877-4302-4577-bfdc-9fc4071f6d0a" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-19ab9877-4302-4577-bfdc-9fc4071f6d0a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Deleting offline snapshot 19ab9877-4302-4577-bfdc-9fc4071f6d0a of volume 7e579b88-dfa6-4fe4-bd73-1423838ebce4 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] snapshot_file for this snap is: volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b06692-1d9f-49d7-9ddc-3bb4bc17b5c2]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:29 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a Sep 03 11:14:29 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:29 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a" returned: 0 in 0.362s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1ad074-d22e-4847-b681-09a5465d2c93]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:29 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:30 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 Sep 03 11:14:30 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:30 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4" returned: 0 in 0.358s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:30 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a Sep 03 11:14:30 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:30 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a" returned: 0 in 0.342s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:30 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a Sep 03 11:14:30 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:30 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:30 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4.19ab9877-4302-4577-bfdc-9fc4071f6d0a" returned: 0 in 0.246s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-19ab9877-4302-4577-bfdc-9fc4071f6d0a" released by "_delete_snapshot" :: held 1.393s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:30 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7e579b88-dfa6-4fe4-bd73-1423838ebce4" released by "delete_snapshot" :: held 1.412s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:30 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Created reservations ['3522e68c-1acb-4ce5-a050-802b3ccd9302', '70fa5dd1-92e8-462f-a1c6-bd7517c93bd2', '5f25b74e-dd0f-41a9-a1fc-954d5d5ed8d4', 'd769f049-4814-47ee-88fc-9dea1b4b17eb'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:31 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Delete snapshot completed successfully. Sep 03 11:14:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-2279790d-51d5-444a-9d4b-fe3edc1bf687 tempest-ProjectMemberTests-1440316641 None] Lock "cinder-19ab9877-4302-4577-bfdc-9fc4071f6d0a-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-7e579b88-dfa6-4fe4-bd73-1423838ebce4-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Lock "cinder-7e579b88-dfa6-4fe4-bd73-1423838ebce4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Acquiring lock "cinder-quobyte-7e579b88-dfa6-4fe4-bd73-1423838ebce4" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:31 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7e579b88-dfa6-4fe4-bd73-1423838ebce4" acquired by "delete_volume" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:31 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e1aaaa-b7b7-4e2b-a26d-91f05a3a586e]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:31 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:31 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 Sep 03 11:14:31 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:32 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4" returned: 0 in 0.345s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:32 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4 Sep 03 11:14:32 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:32 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-7e579b88-dfa6-4fe4-bd73-1423838ebce4" returned: 0 in 0.243s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Lock "cinder-quobyte-7e579b88-dfa6-4fe4-bd73-1423838ebce4" released by "delete_volume" :: held 0.641s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Created reservations ['728f4b87-f225-40ae-9bb8-0baa42964a07', '08032ee5-e5a3-4dbf-b34b-26e2a6716aef', '41db8ffc-d983-44e8-a173-d49a1f44ed0c', '1de7fa37-7b6a-4659-a360-ebc006be0742'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:32 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:32 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:32 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.235s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:32 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Deleted volume successfully. Sep 03 11:14:32 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-63397c72-98fc-48d0-8744-c54bdd4f0feb tempest-ProjectMemberTests-1440316641 None] Lock "cinder-7e579b88-dfa6-4fe4-bd73-1423838ebce4-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (518f16ec-8cfe-44ba-a42d-bdf5bb48acd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a80f1b-ae45-45b1-ab20-91ad16f65897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a80f1b-ae45-45b1-ab20-91ad16f65897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-205723507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8590d5f7-b23f-4970-a7a1-f349facad9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:36Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f86ae84-7807-46da-9d4f-87a64c8da9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f86ae84-7807-46da-9d4f-87a64c8da9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35655ded-5a50-472c-ad41-f96d63bf584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35655ded-5a50-472c-ad41-f96d63bf584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8590d5f7-b23f-4970-a7a1-f349facad9ab', 'volume_name': 'volume-8590d5f7-b23f-4970-a7a1-f349facad9ab', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79984b1a-a4f4-4e65-9794-89d57ec6e7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79984b1a-a4f4-4e65-9794-89d57ec6e7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9315238e-e1d2-4c40-8ea7-d99cd783e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:36 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Volume 8590d5f7-b23f-4970-a7a1-f349facad9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8590d5f7-b23f-4970-a7a1-f349facad9ab', 'volume_size': 1} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-205723507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8590d5f7-b23f-4970-a7a1-f349facad9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:36Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Creating volume 8590d5f7-b23f-4970-a7a1-f349facad9ab {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:36 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:36 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab 1073741824 Sep 03 11:14:36 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:36 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab 1073741824" returned: 0 in 0.401s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:36 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab Sep 03 11:14:36 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:36 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab" returned: 0 in 0.246s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9315238e-e1d2-4c40-8ea7-d99cd783e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8590d5f7-b23f-4970-a7a1-f349facad9ab', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b86c5a4-e628-4810-a3c4-6e303d359c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:36 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Volume volume-8590d5f7-b23f-4970-a7a1-f349facad9ab (8590d5f7-b23f-4970-a7a1-f349facad9ab): created successfully Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b86c5a4-e628-4810-a3c4-6e303d359c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:36 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (518f16ec-8cfe-44ba-a42d-bdf5bb48acd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:36 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-abced9dd-1e2d-4401-9a5f-5b8e7abcc28a tempest-ProjectReaderTests-318079695 None] Created volume successfully. Sep 03 11:14:37 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=151,cinder:INSERT=46,cinder:UPDATE=192,cinder:DELETE=19 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:14:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:37 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Creating offline snapshot b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c of volume 8590d5f7-b23f-4970-a7a1-f349facad9ab {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:14:37 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00b5293-6b00-4f68-b18c-e75b56dc7489]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:37 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab Sep 03 11:14:37 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:37 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab" returned: 0 in 0.353s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:37 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:37 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c 1G Sep 03 11:14:37 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:38 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c 1G" returned: 0 in 0.379s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8590d5f7-b23f-4970-a7a1-f349facad9ab -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:38 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8590d5f7-b23f-4970-a7a1-f349facad9ab -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c Sep 03 11:14:38 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:38 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8590d5f7-b23f-4970-a7a1-f349facad9ab -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c" returned: 0 in 0.284s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:38 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c is being set with open permissions: ugo+rw Sep 03 11:14:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:38 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c Sep 03 11:14:38 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:38 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c" returned: 0 in 0.235s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:38 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=202,cinder:SELECT=145,cinder:INSERT=57,cinder:DELETE=14 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:14:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:38 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.info Sep 03 11:14:38 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:38 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.info" returned: 0 in 0.246s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:38 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.info is being set with open permissions: ugo+rw Sep 03 11:14:38 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:38 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.info Sep 03 11:14:38 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:39 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.info" returned: 0 in 0.246s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:39 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f675f7a4-349a-444b-aa43-da332004a280 tempest-ProjectReaderTests-318079695 None] Create snapshot completed successfully Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Lock "cinder-b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-8590d5f7-b23f-4970-a7a1-f349facad9ab" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-8590d5f7-b23f-4970-a7a1-f349facad9ab" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Deleting offline snapshot b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c of volume 8590d5f7-b23f-4970-a7a1-f349facad9ab {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] snapshot_file for this snap is: volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[031d4721-ca6c-4a71-8f5f-e012c1625c23]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:39 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c Sep 03 11:14:39 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:39 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c" returned: 0 in 0.348s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8590d5f7-b23f-4970-a7a1-f349facad9ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b700da-737c-4ec4-9753-fe7384189e45]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:39 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:40 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab Sep 03 11:14:40 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:40 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab" returned: 0 in 0.348s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:40 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c Sep 03 11:14:40 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:40 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c" returned: 0 in 0.334s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:40 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c Sep 03 11:14:40 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:40 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:40 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab.b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c" returned: 0 in 0.236s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c" released by "_delete_snapshot" :: held 1.353s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:40 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-8590d5f7-b23f-4970-a7a1-f349facad9ab" released by "delete_snapshot" :: held 1.377s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:40 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Created reservations ['1a8699aa-2a70-4605-9fff-187a09e264d6', 'a668d0e0-a9be-4ace-bbab-9c2585dacd92', '06bffe10-a2bf-4ac3-8b87-4e3702b3c6f0', 'dc16829b-8071-4e93-9e07-ab4746e44429'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:41 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Delete snapshot completed successfully. Sep 03 11:14:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-acb4436b-ef54-49fb-b45d-924b5b9b2c3d tempest-ProjectReaderTests-318079695 None] Lock "cinder-b9fdf591-a5a9-4bab-91fb-302b5f5b5c1c-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-8590d5f7-b23f-4970-a7a1-f349facad9ab-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Lock "cinder-8590d5f7-b23f-4970-a7a1-f349facad9ab-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-8590d5f7-b23f-4970-a7a1-f349facad9ab" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:41 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-8590d5f7-b23f-4970-a7a1-f349facad9ab" acquired by "delete_volume" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:41 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca9a69-9099-4a3a-9257-ac6e62b6f34c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:41 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:41 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab Sep 03 11:14:41 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:42 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab" returned: 0 in 0.349s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:42 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab Sep 03 11:14:42 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:42 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-8590d5f7-b23f-4970-a7a1-f349facad9ab" returned: 0 in 0.242s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-8590d5f7-b23f-4970-a7a1-f349facad9ab" released by "delete_volume" :: held 0.643s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Created reservations ['ba0fd058-0bff-40e2-9358-e99eba3ac56e', 'de61b0d5-2989-4a32-8826-e9505ab87d80', '1fb0b0b0-051c-4077-ba60-674fc4440ed4', '17f166a9-6462-47b5-8cb6-968dc3b2f187'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:42 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:42 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:42 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.247s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:42 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Deleted volume successfully. Sep 03 11:14:42 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-787f2440-f9e8-4595-966e-86933f76298e tempest-ProjectReaderTests-318079695 None] Lock "cinder-8590d5f7-b23f-4970-a7a1-f349facad9ab-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (98f5d5c7-faaf-4016-b3e0-63435a365259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b8de8d-54d0-4818-9f23-04ea8fe08abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b8de8d-54d0-4818-9f23-04ea8fe08abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135341917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7e6c04-3428-4b59-adb0-2f450134d3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:43Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfd134b-9aab-4e03-86e7-dd9e671a07b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfd134b-9aab-4e03-86e7-dd9e671a07b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01eec63-7446-4bc8-a6f6-437489a9dd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01eec63-7446-4bc8-a6f6-437489a9dd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7e6c04-3428-4b59-adb0-2f450134d3d8', 'volume_name': 'volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c99b81a-e6cc-4c73-b99a-cece29e2529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c99b81a-e6cc-4c73-b99a-cece29e2529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c25cb4-f9ce-4d07-80b7-749319db46d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:43 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Volume 9b7e6c04-3428-4b59-adb0-2f450134d3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8', 'volume_size': 1} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135341917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7e6c04-3428-4b59-adb0-2f450134d3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:43Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Creating volume 9b7e6c04-3428-4b59-adb0-2f450134d3d8 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:43 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:43 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 1073741824 Sep 03 11:14:43 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:43 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 1073741824" returned: 0 in 0.398s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:43 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:43 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 Sep 03 11:14:43 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:44 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8" returned: 0 in 0.236s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c25cb4-f9ce-4d07-80b7-749319db46d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2400c31-e387-4f1e-964d-41c3c5d433ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:44 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Volume volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 (9b7e6c04-3428-4b59-adb0-2f450134d3d8): created successfully Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2400c31-e387-4f1e-964d-41c3c5d433ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (98f5d5c7-faaf-4016-b3e0-63435a365259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:44 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-e3dd5a18-840c-4d19-a548-9f39c900a250 tempest-ProjectReaderTests-318079695 None] Created volume successfully. Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Creating offline snapshot d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 of volume 9b7e6c04-3428-4b59-adb0-2f450134d3d8 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9f7b50-876c-416d-b3f0-5a1021cd9cdd]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:44 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 Sep 03 11:14:44 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:44 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8" returned: 0 in 0.353s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:44 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:44 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 1G Sep 03 11:14:44 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:45 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 1G" returned: 0 in 0.385s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:45 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 Sep 03 11:14:45 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:45 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5" returned: 0 in 0.286s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:45 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 is being set with open permissions: ugo+rw Sep 03 11:14:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:45 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 Sep 03 11:14:45 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:45 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:45 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.info Sep 03 11:14:45 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:45 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.info" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:45 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.info is being set with open permissions: ugo+rw Sep 03 11:14:45 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:46 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.info Sep 03 11:14:46 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:46 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.info" returned: 0 in 0.237s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:46 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-374e8d71-bcf6-49de-a52e-7733241900a2 tempest-ProjectReaderTests-318079695 None] Create snapshot completed successfully Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Lock "cinder-d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-9b7e6c04-3428-4b59-adb0-2f450134d3d8" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-9b7e6c04-3428-4b59-adb0-2f450134d3d8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Deleting offline snapshot d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 of volume 9b7e6c04-3428-4b59-adb0-2f450134d3d8 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] snapshot_file for this snap is: volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[892542ea-c68a-4972-b501-fd9fdaaa240c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:46 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 Sep 03 11:14:46 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:46 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5" returned: 0 in 0.356s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaf4cd7-fafc-442c-a8e8-6e300a36f582]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:46 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:47 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 Sep 03 11:14:47 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:47 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8" returned: 0 in 0.348s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:47 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 Sep 03 11:14:47 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:47 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5" returned: 0 in 0.332s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:47 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5 Sep 03 11:14:47 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:47 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8.d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5" returned: 0 in 0.244s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5" released by "_delete_snapshot" :: held 1.367s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:47 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-9b7e6c04-3428-4b59-adb0-2f450134d3d8" released by "delete_snapshot" :: held 1.389s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:47 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Created reservations ['affead41-43b7-4de7-9835-fcdcca9d8be7', '7ebbe88a-9704-4473-a67c-791999e0a301', 'd7f76341-5767-492a-83de-6055991367c7', '1bb51656-39b3-42a8-a17c-3e9e4ffaae9e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Delete snapshot completed successfully. Sep 03 11:14:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-24053c58-7a2c-4b76-8b3d-2e97135b4ac2 tempest-ProjectReaderTests-318079695 None] Lock "cinder-d4adb83d-b4c0-4af2-835d-8a2dab3c0cf5-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-9b7e6c04-3428-4b59-adb0-2f450134d3d8-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Lock "cinder-9b7e6c04-3428-4b59-adb0-2f450134d3d8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-9b7e6c04-3428-4b59-adb0-2f450134d3d8" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:48 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-9b7e6c04-3428-4b59-adb0-2f450134d3d8" acquired by "delete_volume" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:48 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0e4f2a-24f8-4907-91e1-057a3c880a40]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:48 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 Sep 03 11:14:48 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:49 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8" returned: 0 in 0.364s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:49 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8 Sep 03 11:14:49 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:49 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-9b7e6c04-3428-4b59-adb0-2f450134d3d8" returned: 0 in 0.241s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-9b7e6c04-3428-4b59-adb0-2f450134d3d8" released by "delete_volume" :: held 0.666s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Created reservations ['e3dd3336-8ecc-4595-b04e-ccfa5d1b67ed', 'bf160b8d-dcde-4c7e-b848-efe985c8ae8a', '9f942074-d89d-4a93-8876-9d7ddaa2ad3a', 'dd17c011-060a-4ebe-92ea-18f0de672316'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:49 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:49 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:49 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.261s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:49 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Deleted volume successfully. Sep 03 11:14:49 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-52a7e99b-5fb9-45c6-a93c-b759041338e3 tempest-ProjectReaderTests-318079695 None] Lock "cinder-9b7e6c04-3428-4b59-adb0-2f450134d3d8-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (a7609c7d-9d54-4969-a09b-078568414e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e34ce2-3619-4345-b511-4c17499ef945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e34ce2-3619-4345-b511-4c17499ef945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210580375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:50Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cf54ba-ddd2-477c-ba4b-29ffea921758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cf54ba-ddd2-477c-ba4b-29ffea921758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10aaaa30-885a-456d-9f72-2caade367d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10aaaa30-885a-456d-9f72-2caade367d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55', 'volume_name': 'volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ea77b1-c253-4cb1-bdec-faa0ae817c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ea77b1-c253-4cb1-bdec-faa0ae817c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77b5429-ea73-4b52-b2b7-cf1dbc09cc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:50 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Volume 59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55', 'volume_size': 1} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210580375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:50Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Creating volume 59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:50 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:50 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 1073741824 Sep 03 11:14:50 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:50 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 1073741824" returned: 0 in 0.401s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:50 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 Sep 03 11:14:50 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:51 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" returned: 0 in 0.248s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77b5429-ea73-4b52-b2b7-cf1dbc09cc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cac63d-68ef-41ae-9308-4af4cfed713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:51 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Volume volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 (59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55): created successfully Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cac63d-68ef-41ae-9308-4af4cfed713a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (a7609c7d-9d54-4969-a09b-078568414e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:51 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-044e0ea6-27d1-44fb-9339-f744e97d4722 tempest-ProjectReaderTests-318079695 None] Created volume successfully. Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Creating offline snapshot c151c130-2a84-4922-9cbd-72f025ec6b66 of volume 59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c73466-7395-4f9d-b8ac-c1429ca745d3]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:51 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 Sep 03 11:14:51 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:51 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" returned: 0 in 0.355s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:51 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 1G Sep 03 11:14:51 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:52 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 1G" returned: 0 in 0.383s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:52 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 Sep 03 11:14:52 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:52 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66" returned: 0 in 0.292s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:52 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 is being set with open permissions: ugo+rw Sep 03 11:14:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:52 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 Sep 03 11:14:52 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:52 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66" returned: 0 in 0.241s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:52 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.info Sep 03 11:14:52 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:53 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.info" returned: 0 in 0.255s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:53 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.info is being set with open permissions: ugo+rw Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:53 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.info Sep 03 11:14:53 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:53 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.info" returned: 0 in 0.248s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:53 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-08f4ec32-f4bd-441b-abdb-7e38c4419bbd tempest-ProjectReaderTests-318079695 None] Create snapshot completed successfully Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-c151c130-2a84-4922-9cbd-72f025ec6b66-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Lock "cinder-c151c130-2a84-4922-9cbd-72f025ec6b66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-c151c130-2a84-4922-9cbd-72f025ec6b66" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-c151c130-2a84-4922-9cbd-72f025ec6b66" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Deleting offline snapshot c151c130-2a84-4922-9cbd-72f025ec6b66 of volume 59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] snapshot_file for this snap is: volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc820c4-508e-4493-9d9b-4ba067838f91]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:53 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:53 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 Sep 03 11:14:53 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:53 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66" returned: 0 in 0.345s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc63e527-3e74-4170-868c-7f52d65eece5]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:54 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 Sep 03 11:14:54 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:54 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" returned: 0 in 0.354s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:54 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 Sep 03 11:14:54 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:54 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66" returned: 0 in 0.328s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:54 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66 Sep 03 11:14:54 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:54 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55.c151c130-2a84-4922-9cbd-72f025ec6b66" returned: 0 in 0.247s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-c151c130-2a84-4922-9cbd-72f025ec6b66" released by "_delete_snapshot" :: held 1.357s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:54 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" released by "delete_snapshot" :: held 1.379s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:55 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Created reservations ['92a130b3-888e-45ad-be74-21cb23ead451', '31909b7d-a830-412b-a702-88bc20d506fc', '1706d936-58dd-4ab6-9854-c2844de04235', '90020cf0-fd3b-4d78-85ab-3752cb729ec9'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:55 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Delete snapshot completed successfully. Sep 03 11:14:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-5b9fa3b6-5a7e-4050-b6ab-afd1c18ddca4 tempest-ProjectReaderTests-318079695 None] Lock "cinder-c151c130-2a84-4922-9cbd-72f025ec6b66-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Lock "cinder-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:55 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" acquired by "delete_volume" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:55 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[492a4364-beee-4f9a-b6d9-b70f50073447]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:55 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:55 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 Sep 03 11:14:55 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:56 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" returned: 0 in 0.362s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:56 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55 Sep 03 11:14:56 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:56 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" returned: 0 in 0.239s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55" released by "delete_volume" :: held 0.658s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Created reservations ['aef7da1c-5089-4edf-959a-e93f81ff8ba1', 'a2a074ee-4f2b-4d01-8324-6039d8fb3ead', '616bb131-dcac-4a3a-8629-c81dc1acfca0', 'be3b6c93-2e68-4ead-be4b-94781899037d'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:56 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:14:56 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:56 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.251s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Deleted volume successfully. Sep 03 11:14:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-1cf7fe84-3da1-4a5d-ba9a-616c5b167451 tempest-ProjectReaderTests-318079695 None] Lock "cinder-59b1b1ed-75ea-4819-a3fb-6c5c9bcb4c55-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (02b5859f-df2b-4b19-840f-398b23dbfc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766d7fcb-c3d9-46ad-9a36-86e673997a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766d7fcb-c3d9-46ad-9a36-86e673997a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2047631003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772b533c-8d23-40c3-adb1-6801da4eec4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:57Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebac4ac-b68a-4f03-814c-e18a483bf57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebac4ac-b68a-4f03-814c-e18a483bf57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130b26e5-90d9-4ad3-b4c9-16fd66513c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (130b26e5-90d9-4ad3-b4c9-16fd66513c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772b533c-8d23-40c3-adb1-6801da4eec4c', 'volume_name': 'volume-772b533c-8d23-40c3-adb1-6801da4eec4c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cad749-e9da-4b6c-8ab2-fcb5116a1276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37cad749-e9da-4b6c-8ab2-fcb5116a1276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17712ec-3b9f-4293-b75b-a075c93f1a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:57 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Volume 772b533c-8d23-40c3-adb1-6801da4eec4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772b533c-8d23-40c3-adb1-6801da4eec4c', 'volume_size': 1} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2047631003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772b533c-8d23-40c3-adb1-6801da4eec4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:57Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Creating volume 772b533c-8d23-40c3-adb1-6801da4eec4c {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:57 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:57 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c 1073741824 Sep 03 11:14:57 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:57 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c 1073741824" returned: 0 in 0.395s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:57 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c Sep 03 11:14:57 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:58 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17712ec-3b9f-4293-b75b-a075c93f1a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772b533c-8d23-40c3-adb1-6801da4eec4c', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0aaa10-e905-4ac3-b260-d5d0d85cfee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:58 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Volume volume-772b533c-8d23-40c3-adb1-6801da4eec4c (772b533c-8d23-40c3-adb1-6801da4eec4c): created successfully Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0aaa10-e905-4ac3-b260-d5d0d85cfee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (02b5859f-df2b-4b19-840f-398b23dbfc58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:58 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-4ee70353-533d-4e3c-a2b3-bd708993f3fa tempest-ProjectReaderTests-318079695 None] Created volume successfully. Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Creating offline snapshot d3a7d810-d10d-4960-82f6-2d7547fa5e42 of volume 772b533c-8d23-40c3-adb1-6801da4eec4c {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b17006-3f5a-4218-8527-ae4a2b7cafb1]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:58 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c Sep 03 11:14:58 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:58 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c" returned: 0 in 0.354s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:58 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 1G Sep 03 11:14:58 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:59 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 1G" returned: 0 in 0.380s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-772b533c-8d23-40c3-adb1-6801da4eec4c -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:59 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-772b533c-8d23-40c3-adb1-6801da4eec4c -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 Sep 03 11:14:59 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:59 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-772b533c-8d23-40c3-adb1-6801da4eec4c -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42" returned: 0 in 0.286s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:59 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 is being set with open permissions: ugo+rw Sep 03 11:14:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:59 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 Sep 03 11:14:59 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:59 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42" returned: 0 in 0.252s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:59 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.info Sep 03 11:14:59 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:00 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.info" returned: 0 in 0.251s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:00 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.info is being set with open permissions: ugo+rw Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:00 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.info Sep 03 11:15:00 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:00 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.info" returned: 0 in 0.254s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-bf1554eb-f6d6-4e05-9baf-3da9e5f517dc tempest-ProjectReaderTests-318079695 None] Create snapshot completed successfully Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-d3a7d810-d10d-4960-82f6-2d7547fa5e42-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Lock "cinder-d3a7d810-d10d-4960-82f6-2d7547fa5e42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-772b533c-8d23-40c3-adb1-6801da4eec4c" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-772b533c-8d23-40c3-adb1-6801da4eec4c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-d3a7d810-d10d-4960-82f6-2d7547fa5e42" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-d3a7d810-d10d-4960-82f6-2d7547fa5e42" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Deleting offline snapshot d3a7d810-d10d-4960-82f6-2d7547fa5e42 of volume 772b533c-8d23-40c3-adb1-6801da4eec4c {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] snapshot_file for this snap is: volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7bc835-963b-4027-b791-6b16e882a3fe]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:00 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 Sep 03 11:15:00 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:01 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42" returned: 0 in 0.357s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-772b533c-8d23-40c3-adb1-6801da4eec4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:15:01 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84ae992-0d88-4375-b522-c1dad215be43]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:01 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c Sep 03 11:15:01 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:01 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c" returned: 0 in 0.360s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:01 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 Sep 03 11:15:01 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:01 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42" returned: 0 in 0.344s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:01 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42 Sep 03 11:15:01 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:02 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c.d3a7d810-d10d-4960-82f6-2d7547fa5e42" returned: 0 in 0.251s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-d3a7d810-d10d-4960-82f6-2d7547fa5e42" released by "_delete_snapshot" :: held 1.398s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-772b533c-8d23-40c3-adb1-6801da4eec4c" released by "delete_snapshot" :: held 1.420s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Created reservations ['8c3281ff-92e1-4937-9095-1ae0a0e4afe6', '9846f8d3-376d-416b-a5fd-15affbd3e338', 'd97c4983-0800-4359-8ef7-488b2523fd10', 'c1e3ca15-5ce6-4a03-a314-ac745d7806a6'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:02 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Delete snapshot completed successfully. Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-ad964e95-32cd-42aa-aa40-7612d233224e tempest-ProjectReaderTests-318079695 None] Lock "cinder-d3a7d810-d10d-4960-82f6-2d7547fa5e42-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-772b533c-8d23-40c3-adb1-6801da4eec4c-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Lock "cinder-772b533c-8d23-40c3-adb1-6801da4eec4c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-772b533c-8d23-40c3-adb1-6801da4eec4c" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-772b533c-8d23-40c3-adb1-6801da4eec4c" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b276b43-243e-40fd-a2ca-b42445392dde]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:02 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:02 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c Sep 03 11:15:02 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:03 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c" returned: 0 in 0.391s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:03 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c Sep 03 11:15:03 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:03 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-772b533c-8d23-40c3-adb1-6801da4eec4c" returned: 0 in 0.247s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-772b533c-8d23-40c3-adb1-6801da4eec4c" released by "delete_volume" :: held 0.692s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Created reservations ['6a24f232-5540-4955-a21b-12919466e089', '1821e5d1-bcf2-49b2-a9ea-07e454c11ccf', 'd35b83ca-b0fe-4901-b34e-2878b25fa401', '7558641e-c32f-497e-878c-c4e3234a755e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:03 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:15:03 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:03 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:03 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Deleted volume successfully. Sep 03 11:15:03 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-92533263-c53b-45cc-93cf-f17e51fdf470 tempest-ProjectReaderTests-318079695 None] Lock "cinder-772b533c-8d23-40c3-adb1-6801da4eec4c-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (118a4718-1cc8-4f90-9c4f-c8e8dd05fdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22139a8-b9fa-45fe-ab32-035b2f027db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22139a8-b9fa-45fe-ab32-035b2f027db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657612554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583b37f1-6618-41b8-a7b9-7c94a19977ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:04Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff99e8c-a66f-4101-bb4c-81bf2a4dad5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff99e8c-a66f-4101-bb4c-81bf2a4dad5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173d2255-365d-4e7a-a8d1-26e7454fccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173d2255-365d-4e7a-a8d1-26e7454fccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '583b37f1-6618-41b8-a7b9-7c94a19977ae', 'volume_name': 'volume-583b37f1-6618-41b8-a7b9-7c94a19977ae', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c0a377-e6ff-482a-afdf-4ba1187682e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c0a377-e6ff-482a-afdf-4ba1187682e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9a4a32-f5f0-438e-aed0-dd6cffdb59ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Volume 583b37f1-6618-41b8-a7b9-7c94a19977ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-583b37f1-6618-41b8-a7b9-7c94a19977ae', 'volume_size': 1} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657612554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583b37f1-6618-41b8-a7b9-7c94a19977ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dde526ea077464c9383f170598f3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:04Z,use_quota=True,user_id='a5a1f2c387ec4912a1818b28939ba699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Creating volume 583b37f1-6618-41b8-a7b9-7c94a19977ae {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:15:04 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:04 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae 1073741824 Sep 03 11:15:04 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:04 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae 1073741824" returned: 0 in 0.407s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:04 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:04 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae Sep 03 11:15:04 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:05 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae" returned: 0 in 0.250s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9a4a32-f5f0-438e-aed0-dd6cffdb59ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583b37f1-6618-41b8-a7b9-7c94a19977ae', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd93ecdf-1c6b-43f5-987d-bef7937a4154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:05 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Volume volume-583b37f1-6618-41b8-a7b9-7c94a19977ae (583b37f1-6618-41b8-a7b9-7c94a19977ae): created successfully Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd93ecdf-1c6b-43f5-987d-bef7937a4154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Flow 'volume_create_manager' (118a4718-1cc8-4f90-9c4f-c8e8dd05fdcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:05 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-a71356c7-51bf-434a-a2b4-3539954f0d5a tempest-ProjectReaderTests-318079695 None] Created volume successfully. Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Creating offline snapshot 20485079-40ea-4451-b96d-cfcab8436fbe of volume 583b37f1-6618-41b8-a7b9-7c94a19977ae {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dc80be-682c-4285-a5e3-3ec2b65d8787]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:05 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae Sep 03 11:15:05 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:05 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae" returned: 0 in 0.351s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:05 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:05 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe 1G Sep 03 11:15:05 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:06 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe 1G" returned: 0 in 0.390s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-583b37f1-6618-41b8-a7b9-7c94a19977ae -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:06 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-583b37f1-6618-41b8-a7b9-7c94a19977ae -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe Sep 03 11:15:06 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:06 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-583b37f1-6618-41b8-a7b9-7c94a19977ae -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe" returned: 0 in 0.292s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:06 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe is being set with open permissions: ugo+rw Sep 03 11:15:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:06 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe Sep 03 11:15:06 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:06 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe" returned: 0 in 0.247s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:06 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:06 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.info Sep 03 11:15:06 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:07 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.info" returned: 0 in 0.257s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:07 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.info is being set with open permissions: ugo+rw Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:07 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.info Sep 03 11:15:07 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:07 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.info" returned: 0 in 0.240s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:07 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-15a1254a-4a71-40e4-bc15-a5f6ce71ffec tempest-ProjectReaderTests-318079695 None] Create snapshot completed successfully Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-20485079-40ea-4451-b96d-cfcab8436fbe-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Lock "cinder-20485079-40ea-4451-b96d-cfcab8436fbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-583b37f1-6618-41b8-a7b9-7c94a19977ae" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-583b37f1-6618-41b8-a7b9-7c94a19977ae" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-20485079-40ea-4451-b96d-cfcab8436fbe" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-20485079-40ea-4451-b96d-cfcab8436fbe" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Deleting offline snapshot 20485079-40ea-4451-b96d-cfcab8436fbe of volume 583b37f1-6618-41b8-a7b9-7c94a19977ae {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] snapshot_file for this snap is: volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c314b8c4-5a3a-4fbd-a205-84178221fce8]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:07 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:07 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe Sep 03 11:15:07 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:08 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe" returned: 0 in 0.376s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:08 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-583b37f1-6618-41b8-a7b9-7c94a19977ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:15:08 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cef076-9d88-4673-ac77-0328deeb1692]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:08 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae Sep 03 11:15:08 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:08 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae" returned: 0 in 0.362s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:08 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe Sep 03 11:15:08 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:08 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe" returned: 0 in 0.336s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:08 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:08 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe Sep 03 11:15:08 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:09 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae.20485079-40ea-4451-b96d-cfcab8436fbe" returned: 0 in 0.248s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-20485079-40ea-4451-b96d-cfcab8436fbe" released by "_delete_snapshot" :: held 1.407s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-583b37f1-6618-41b8-a7b9-7c94a19977ae" released by "delete_snapshot" :: held 1.430s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Created reservations ['8d39d8b2-05e6-4994-8027-3869caa88f49', 'fed8b5ce-5f07-4389-95d5-29a370b8f4c3', 'b0089840-4400-4225-9305-821ff2245b8d', 'ad2296c8-2fef-4e09-b8b0-01b7a4880f00'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:09 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Delete snapshot completed successfully. Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b050fcfb-3d1e-4e10-b58e-ddb4566a3e53 tempest-ProjectReaderTests-318079695 None] Lock "cinder-20485079-40ea-4451-b96d-cfcab8436fbe-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-583b37f1-6618-41b8-a7b9-7c94a19977ae-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Lock "cinder-583b37f1-6618-41b8-a7b9-7c94a19977ae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Acquiring lock "cinder-quobyte-583b37f1-6618-41b8-a7b9-7c94a19977ae" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-583b37f1-6618-41b8-a7b9-7c94a19977ae" acquired by "delete_volume" :: waited 0.016s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd6157-ddb0-464a-b431-2486aee02885]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:09 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:10 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae Sep 03 11:15:10 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:10 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae" returned: 0 in 0.355s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:10 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae Sep 03 11:15:10 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:10 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-583b37f1-6618-41b8-a7b9-7c94a19977ae" returned: 0 in 0.252s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Lock "cinder-quobyte-583b37f1-6618-41b8-a7b9-7c94a19977ae" released by "delete_volume" :: held 0.663s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Created reservations ['98695121-e940-4a52-9b96-767181382e33', 'e3d8ee46-880f-4696-ab65-9663c2f3072b', 'dd18b9e4-9218-4e27-af65-ecc1f961afea', '41ada46d-de37-4403-b509-257cc93868e5'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:10 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:15:10 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:10 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.258s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:10 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Deleted volume successfully. Sep 03 11:15:10 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f134b6c5-eb81-4f7c-9375-3a912639c76c tempest-ProjectReaderTests-318079695 None] Lock "cinder-583b37f1-6618-41b8-a7b9-7c94a19977ae-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:20 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=60,cinder:DELETE=9,cinder:INSERT=27,cinder:UPDATE=87 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:15:20 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=86,cinder:SELECT=73,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Flow 'volume_create_manager' (48907de2-bf7d-494a-9791-de7c0b7cabe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee7e5ab-7639-4cce-83cc-4778fa69ae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee7e5ab-7639-4cce-83cc-4778fa69ae8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1276918765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce7c45a-0099-43d3-b904-772b66ca52d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe18acdb58246dca0adf4247d197d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:23Z,use_quota=True,user_id='5de3ae75e8724819859813a3d49da752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec7f104-f5de-4764-9251-d598b8fa5df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec7f104-f5de-4764-9251-d598b8fa5df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a314e2-6e24-480c-b598-3a19acedd0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a314e2-6e24-480c-b598-3a19acedd0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce7c45a-0099-43d3-b904-772b66ca52d8', 'volume_name': 'volume-0ce7c45a-0099-43d3-b904-772b66ca52d8', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a38656e-0319-45fe-a84d-bfc525633005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a38656e-0319-45fe-a84d-bfc525633005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a693af8b-ad13-4356-8fb8-426cf5d631b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:23 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Volume 0ce7c45a-0099-43d3-b904-772b66ca52d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce7c45a-0099-43d3-b904-772b66ca52d8', 'volume_size': 1} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1276918765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce7c45a-0099-43d3-b904-772b66ca52d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe18acdb58246dca0adf4247d197d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:23Z,use_quota=True,user_id='5de3ae75e8724819859813a3d49da752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Creating volume 0ce7c45a-0099-43d3-b904-772b66ca52d8 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:15:23 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:23 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 1073741824 Sep 03 11:15:23 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:23 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:15:23 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:23 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 1073741824" returned: 0 in 0.425s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:23 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 Sep 03 11:15:23 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:23 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.267s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:15:23 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8" returned: 0 in 0.245s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a693af8b-ad13-4356-8fb8-426cf5d631b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce7c45a-0099-43d3-b904-772b66ca52d8', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9154513e-f617-47eb-946b-bb00849e7dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:23 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Volume volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 (0ce7c45a-0099-43d3-b904-772b66ca52d8): created successfully Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9154513e-f617-47eb-946b-bb00849e7dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Flow 'volume_create_manager' (48907de2-bf7d-494a-9791-de7c0b7cabe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:23 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-2b78934f-a817-4303-b172-8671f6ba1379 tempest-ProjectReaderTests-1436432948 None] Created volume successfully. Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Acquiring lock "cinder-0ce7c45a-0099-43d3-b904-772b66ca52d8-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Lock "cinder-0ce7c45a-0099-43d3-b904-772b66ca52d8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Acquiring lock "cinder-quobyte-0ce7c45a-0099-43d3-b904-772b66ca52d8" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Lock "cinder-quobyte-0ce7c45a-0099-43d3-b904-772b66ca52d8" acquired by "delete_volume" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[a083bdf5-d117-4503-ad95-29d9159ae9cd]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:24 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 Sep 03 11:15:24 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:24 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8" returned: 0 in 0.352s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:24 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8 Sep 03 11:15:24 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:24 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-0ce7c45a-0099-43d3-b904-772b66ca52d8" returned: 0 in 0.245s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:24 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Lock "cinder-quobyte-0ce7c45a-0099-43d3-b904-772b66ca52d8" released by "delete_volume" :: held 0.634s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Created reservations ['153da891-c3d9-4fe2-b601-75fd425ffd10', '1a4a3379-6e6d-4f6a-bae4-01edb9ac19b6', '20b16b0c-8c2b-49a6-a6cf-8da336914528', '59c93b57-3647-4405-bb0d-8c08e5df042e'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:25 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:15:25 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:25 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.243s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:25 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Deleted volume successfully. Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-0fdbd2cc-53f6-4525-bf67-20127d24b9dc tempest-ProjectReaderTests-1436432948 None] Lock "cinder-0ce7c45a-0099-43d3-b904-772b66ca52d8-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Flow 'volume_create_manager' (bf22c917-0ed6-4f33-ab95-49572654ec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf7a0e5-82ca-4019-bdac-3ca429baabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf7a0e5-82ca-4019-bdac-3ca429baabcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457540131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a446074-a80d-4685-ac45-e1a74566639e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe18acdb58246dca0adf4247d197d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:26Z,use_quota=True,user_id='5de3ae75e8724819859813a3d49da752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0993ad6e-8808-45e4-afc2-25a2d91e19e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0993ad6e-8808-45e4-afc2-25a2d91e19e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97d5638-a015-4771-ae28-0093a6d1e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97d5638-a015-4771-ae28-0093a6d1e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a446074-a80d-4685-ac45-e1a74566639e', 'volume_name': 'volume-1a446074-a80d-4685-ac45-e1a74566639e', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4875c087-9cf3-4849-bd11-f7c2a1947f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4875c087-9cf3-4849-bd11-f7c2a1947f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5b46e0-0b93-4fec-92de-e672ce360bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:25 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Volume 1a446074-a80d-4685-ac45-e1a74566639e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a446074-a80d-4685-ac45-e1a74566639e', 'volume_size': 1} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457540131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a446074-a80d-4685-ac45-e1a74566639e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe18acdb58246dca0adf4247d197d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:26Z,use_quota=True,user_id='5de3ae75e8724819859813a3d49da752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Creating volume 1a446074-a80d-4685-ac45-e1a74566639e {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:15:25 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:15:25 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:25 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e 1073741824 Sep 03 11:15:26 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:26 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e 1073741824" returned: 0 in 0.405s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:26 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e Sep 03 11:15:26 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:26 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e" returned: 0 in 0.244s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5b46e0-0b93-4fec-92de-e672ce360bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a446074-a80d-4685-ac45-e1a74566639e', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330afcb3-0a80-4586-a502-7fcac6987575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:26 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Volume volume-1a446074-a80d-4685-ac45-e1a74566639e (1a446074-a80d-4685-ac45-e1a74566639e): created successfully Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330afcb3-0a80-4586-a502-7fcac6987575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Flow 'volume_create_manager' (bf22c917-0ed6-4f33-ab95-49572654ec07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:26 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-24b97de8-da37-4dc0-94a6-b6d50c611bda tempest-ProjectReaderTests-1436432948 None] Created volume successfully. Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Acquiring lock "cinder-1a446074-a80d-4685-ac45-e1a74566639e-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Lock "cinder-1a446074-a80d-4685-ac45-e1a74566639e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Acquiring lock "cinder-quobyte-1a446074-a80d-4685-ac45-e1a74566639e" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:26 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Lock "cinder-quobyte-1a446074-a80d-4685-ac45-e1a74566639e" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034b61e-9b32-4101-a3d9-189d8a59b099]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:27 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e Sep 03 11:15:27 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:27 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e" returned: 0 in 0.367s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:27 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e Sep 03 11:15:27 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:27 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-1a446074-a80d-4685-ac45-e1a74566639e" returned: 0 in 0.249s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Lock "cinder-quobyte-1a446074-a80d-4685-ac45-e1a74566639e" released by "delete_volume" :: held 0.652s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Created reservations ['abcdac3a-7eeb-4808-942b-7fcd5d95a562', 'f596f776-9e55-4cc5-9b53-356f0e4ed0ff', '3608d62b-7c2c-414c-8803-db3ca6807ec2', 'cbfa064a-a8f1-4009-b46f-701a8ea9c893'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:27 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:27 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:15:27 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:28 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:28 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.251s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:28 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:28 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Deleted volume successfully. Sep 03 11:15:28 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f216eff1-a3f7-44a6-be4b-29f0032222f4 tempest-ProjectReaderTests-1436432948 None] Lock "cinder-1a446074-a80d-4685-ac45-e1a74566639e-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:38 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=23,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:15:42 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=15,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Flow 'volume_create_manager' (d2c5b1a2-7c51-4cc0-973d-80f5f53f40ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafc6f15-4eba-493c-bf57-cf5b33488fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bafc6f15-4eba-493c-bf57-cf5b33488fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1635152446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2411f8a2-beef-45f1-a663-a2d5f6104ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb156566934491e8283e57c52a46367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:48Z,use_quota=True,user_id='ba539ddb527b488ea553faea43af668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12208dee-d235-46a1-ac8d-1262095f173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12208dee-d235-46a1-ac8d-1262095f173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd254b90-a62d-46f9-a6a0-15d29f1047ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd254b90-a62d-46f9-a6a0-15d29f1047ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2411f8a2-beef-45f1-a663-a2d5f6104ec3', 'volume_name': 'volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0446207-1e1d-48ac-adad-4c6dec1dcb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0446207-1e1d-48ac-adad-4c6dec1dcb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b9b5c3-3182-4a58-bf2c-93a61f0dd1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:47 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Volume 2411f8a2-beef-45f1-a663-a2d5f6104ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3', 'volume_size': 1} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1635152446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2411f8a2-beef-45f1-a663-a2d5f6104ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb156566934491e8283e57c52a46367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:48Z,use_quota=True,user_id='ba539ddb527b488ea553faea43af668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)}" {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Creating volume 2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:15:47 devstack cinder-volume[86603]: INFO cinder.volume.drivers.remotefs [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] casted to osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 Sep 03 11:15:47 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 1073741824 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:47 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 1073741824 Sep 03 11:15:47 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:48 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 1073741824" returned: 0 in 0.411s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:48 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 Sep 03 11:15:48 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:48 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'} {{(pid=86603) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b9b5c3-3182-4a58-bf2c-93a61f0dd1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3', 'volume_size': 1}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc74f2ec-b524-4311-8a9b-dce392c1f8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:48 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Volume volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 (2411f8a2-beef-45f1-a663-a2d5f6104ec3): created successfully Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc74f2ec-b524-4311-8a9b-dce392c1f8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Flow 'volume_create_manager' (d2c5b1a2-7c51-4cc0-973d-80f5f53f40ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:48 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f613fe33-657a-4452-96ea-88e080f9907f tempest-SnapshotDependencyTests-1318944708 None] Created volume successfully. Sep 03 11:15:48 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:49 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Creating offline snapshot e4b763cd-55c4-49c9-9206-e63874f16839 of volume 2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:15:49 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c48ddf-17b1-4d97-b1eb-36148b4e1dd4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:49 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 Sep 03 11:15:49 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:49 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3" returned: 0 in 0.383s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 1G {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:49 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 1G Sep 03 11:15:49 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:49 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 1G" returned: 0 in 0.397s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:49 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:49 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 Sep 03 11:15:49 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:50 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 -F qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839" returned: 0 in 0.282s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:50 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 is being set with open permissions: ugo+rw Sep 03 11:15:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:50 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 Sep 03 11:15:50 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:50 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839" returned: 0 in 0.244s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:50 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.info Sep 03 11:15:50 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:50 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.info" returned: 0 in 0.244s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:50 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.info is being set with open permissions: ugo+rw Sep 03 11:15:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.info {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:50 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.info Sep 03 11:15:50 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:50 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.info" returned: 0 in 0.252s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:50 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:50 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-79a85ce7-c950-4795-a7cd-812a0950f7ec tempest-SnapshotDependencyTests-1318944708 None] Create snapshot completed successfully Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.flows.manager.create_volume [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86603) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Flow 'volume_create_manager' (5a10d7a8-876f-4cef-b112-ec53e6c3ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50698da6-14ec-45a2-a579-283bacb1e7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50698da6-14ec-45a2-a579-283bacb1e7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca626553-723d-4412-9d73-aa161953dca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb156566934491e8283e57c52a46367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4b763cd-55c4-49c9-9206-e63874f16839,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:52Z,use_quota=True,user_id='ba539ddb527b488ea553faea43af668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9be959-bfc2-456f-b2b1-067433cdf7c6),volume_type_id=3b9be959-bfc2-456f-b2b1-067433cdf7c6)' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb1436f-d478-437b-b519-a350aab15e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb1436f-d478-437b-b519-a350aab15e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec282e9-7a7c-46e0-963c-f6b33588db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec282e9-7a7c-46e0-963c-f6b33588db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca626553-723d-4412-9d73-aa161953dca7', 'volume_name': 'volume-ca626553-723d-4412-9d73-aa161953dca7', 'volume_size': 1, 'snapshot_id': 'e4b763cd-55c4-49c9-9206-e63874f16839'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c36295-a092-4baa-9374-f05ceafe35ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c36295-a092-4baa-9374-f05ceafe35ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cea5541-b53f-4dbc-bef2-2a6348f54b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:51 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Volume ca626553-723d-4412-9d73-aa161953dca7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca626553-723d-4412-9d73-aa161953dca7', 'volume_size': 1, 'snapshot_id': 'e4b763cd-55c4-49c9-9206-e63874f16839'} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "cinder-quobyte-e4b763cd-55c4-49c9-9206-e63874f16839-ca626553-723d-4412-9d73-aa161953dca7" by "_create_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-e4b763cd-55c4-49c9-9206-e63874f16839-ca626553-723d-4412-9d73-aa161953dca7" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Creating volume ca626553-723d-4412-9d73-aa161953dca7 from snapshot e4b763cd-55c4-49c9-9206-e63874f16839 {{(pid=86603) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Selected osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6 as target Quobyte volume. {{(pid=86603) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "cinder-quobyte-ca626553-723d-4412-9d73-aa161953dca7" by "_copy_volume_from_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-ca626553-723d-4412-9d73-aa161953dca7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] snapshot: e4b763cd-55c4-49c9-9206-e63874f16839, volume: ca626553-723d-4412-9d73-aa161953dca7, {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9401708-f8d1-4a59-9a53-59a33e66c0a4]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:51 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:51 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 Sep 03 11:15:51 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:52 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839" returned: 0 in 0.355s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:15:52 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a6db2-b84b-4a09-841f-c6280476bf6c]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:52 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 Sep 03 11:15:52 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:52 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3" returned: 0 in 0.348s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:15:52 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Creating direct copy from snapshot {{(pid=86603) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:15:52 devstack cinder-volume[86603]: DEBUG cinder.utils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Path /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 not found in is_blk_device check {{(pid=86603) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:15:52 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:52 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 Sep 03 11:15:52 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:56 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7" returned: 0 in 4.004s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG cinder.image.image_utils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Image conversion details: src /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 {{(pid=86603) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:15:56 devstack cinder-volume[86603]: INFO cinder.image.image_utils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Converted 1024.00 MB image at 255.66 MB/s Sep 03 11:15:56 devstack cinder-volume[86603]: WARNING cinder.volume.drivers.remotefs [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 is being set with open permissions: ugo+rw Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:56 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 Sep 03 11:15:56 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:56 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7" returned: 0 in 0.250s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-ca626553-723d-4412-9d73-aa161953dca7" released by "_copy_volume_from_snapshot" :: held 5.030s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-e4b763cd-55c4-49c9-9206-e63874f16839-ca626553-723d-4412-9d73-aa161953dca7" released by "_create_volume_from_snapshot" :: held 5.090s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.106s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cea5541-b53f-4dbc-bef2-2a6348f54b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca626553-723d-4412-9d73-aa161953dca7', 'volume_size': 1, 'snapshot_id': 'e4b763cd-55c4-49c9-9206-e63874f16839'}' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b79fdf3-4f3d-45de-a71c-6cf6a51db073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:56 devstack cinder-volume[86603]: INFO cinder.volume.flows.manager.create_volume [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Volume volume-ca626553-723d-4412-9d73-aa161953dca7 (ca626553-723d-4412-9d73-aa161953dca7): created successfully Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b79fdf3-4f3d-45de-a71c-6cf6a51db073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86603) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:56 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Flow 'volume_create_manager' (5a10d7a8-876f-4cef-b112-ec53e6c3ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86603) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:56 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-f895cb4e-9cb6-4103-9911-5705cfce2afa tempest-SnapshotDependencyTests-1318944708 None] Created volume successfully. Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "cinder-e4b763cd-55c4-49c9-9206-e63874f16839-delete_snapshot" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-e4b763cd-55c4-49c9-9206-e63874f16839-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "cinder-quobyte-2411f8a2-beef-45f1-a663-a2d5f6104ec3" by "delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-2411f8a2-beef-45f1-a663-a2d5f6104ec3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "cinder-quobyte-e4b763cd-55c4-49c9-9206-e63874f16839" by "_delete_snapshot" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-e4b763cd-55c4-49c9-9206-e63874f16839" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Deleting offline snapshot e4b763cd-55c4-49c9-9206-e63874f16839 of volume 2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] snapshot_file for this snap is: volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 {{(pid=86603) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76977fe-ca83-4bf1-9f4a-4caf65193656]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:57 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 Sep 03 11:15:57 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:57 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839" returned: 0 in 0.355s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.remotefs [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86603) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[2702a62d-7282-42f9-a3e6-3c2e8a7acb41]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:57 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:57 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 Sep 03 11:15:57 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:58 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3" returned: 0 in 0.537s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:58 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 Sep 03 11:15:58 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:58 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839" returned: 0 in 0.311s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:58 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839 Sep 03 11:15:58 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:58 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:58 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3.e4b763cd-55c4-49c9-9206-e63874f16839" returned: 0 in 0.250s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-e4b763cd-55c4-49c9-9206-e63874f16839" released by "_delete_snapshot" :: held 1.545s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-2411f8a2-beef-45f1-a663-a2d5f6104ec3" released by "delete_snapshot" :: held 1.566s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:58 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Created reservations ['b459204d-181d-4ecd-9b37-4552a94467b3', 'a73b1f8a-82c0-47d9-ab65-669fc5aedc48', '629a0a73-dbbb-42f4-b3a6-6b9f1317cb0a', 'da9ea346-0524-460c-902e-4470bb1c9c20'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:58 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Delete snapshot completed successfully. Sep 03 11:15:58 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-b357a020-03fd-4b37-8a07-9eb3c8db59bf tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-e4b763cd-55c4-49c9-9206-e63874f16839-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "cinder-2411f8a2-beef-45f1-a663-a2d5f6104ec3-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-2411f8a2-beef-45f1-a663-a2d5f6104ec3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "cinder-quobyte-2411f8a2-beef-45f1-a663-a2d5f6104ec3" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:59 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-2411f8a2-beef-45f1-a663-a2d5f6104ec3" acquired by "delete_volume" :: waited 0.014s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:59 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[d217b5c3-8812-4de2-8a26-c016b91ec743]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:59 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 Sep 03 11:15:59 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:59 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3" returned: 0 in 0.364s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:59 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:59 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3 Sep 03 11:15:59 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:00 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-2411f8a2-beef-45f1-a663-a2d5f6104ec3" returned: 0 in 0.249s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-2411f8a2-beef-45f1-a663-a2d5f6104ec3" released by "delete_volume" :: held 0.666s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Created reservations ['52e488cd-3567-42c9-bd24-7b6add629560', '69765de4-9a01-4d73-b20e-06c9508cdf5f', 'c725aeee-48ae-4d85-beff-a02d98af6860', '724eb24c-1898-49f2-9881-22c0283820a4'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:00 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:16:00 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:00 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.253s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:00 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Deleted volume successfully. Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-21446b29-a6f3-4a05-afff-f65050b167d5 tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-2411f8a2-beef-45f1-a663-a2d5f6104ec3-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "cinder-ca626553-723d-4412-9d73-aa161953dca7-delete_volume" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-ca626553-723d-4412-9d73-aa161953dca7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "cinder-quobyte-ca626553-723d-4412-9d73-aa161953dca7" by "delete_volume" {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-ca626553-723d-4412-9d73-aa161953dca7" acquired by "delete_volume" :: waited 0.015s {{(pid=86603) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32edb31-6d75-412b-9c26-0e00bce986da]: (4, 'qcow2') {{(pid=87787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:00 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 Sep 03 11:16:00 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:00 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7" returned: 0 in 0.361s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:00 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:00 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7 Sep 03 11:16:00 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:01 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6/volume-ca626553-723d-4412-9d73-aa161953dca7" returned: 0 in 0.251s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-quobyte-ca626553-723d-4412-9d73-aa161953dca7" released by "delete_volume" :: held 0.656s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG cinder.quota [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Created reservations ['01520d5a-293a-41a2-a9c5-8e388d7bdffe', 'a9b2807b-5e4a-4774-a602-aed4d2290f12', '97c59a84-aee0-435c-bd83-0d4e26eb0984', 'b2bbf880-e5b3-478d-9edf-e167b2faacc8'] {{(pid=86603) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:01 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:16:01 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:01 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.243s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:01 devstack cinder-volume[86603]: INFO cinder.volume.manager [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Deleted volume successfully. Sep 03 11:16:01 devstack cinder-volume[86603]: DEBUG cinder.coordination [None req-feb39883-4bcb-4875-b1ca-79929fd70904 tempest-SnapshotDependencyTests-1318944708 None] Lock "cinder-ca626553-723d-4412-9d73-aa161953dca7-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86603) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:11 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:SELECT=27,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:16:11 devstack cinder-volume[86603]: DEBUG dbcounter [-] [86603] Writing DB stats cinder:UPDATE=27,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86603) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6': None} {{(pid=86603) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG cinder.volume.drivers.quobyte [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7375b310-5fe0-441c-a580-ea7d7abe16e6'] {{(pid=86603) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.lockutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86603) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:23 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6 Sep 03 11:16:23 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:23 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG oslo_concurrency.processutils [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e349af59862e1c33b7205ca323e65ec6" returned: 0 in 0.261s {{(pid=86603) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG cinder.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Notifying Schedulers of capabilities ... {{(pid=86603) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG oslo_service.periodic_task [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] Running periodic task VolumeManager._thread_info {{(pid=86603) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread count: 29 {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:16:23 devstack cinder-volume[86603]: DEBUG cinder.volume.manager [None req-56543786-5b01-4e39-992e-3d6820c17de1 None None] thread info: [<_MainThread(MainThread, started 136836952498304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86603) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}